-- Logs begin at Wed 2022-07-06 14:42:34 UTC, end at Wed 2022-07-06 15:44:35 UTC. -- Jul 06 15:16:22.078152 dv-cinder-848848-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 06 15:16:22.086192 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 15:16:22 2022] *** Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: nodename: dv-cinder-848848-4-iscsi Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: machine: x86_64 Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: clock source: unix Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: pcre jit disabled Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: detected number of CPU cores: 4 Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: current working directory: / Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: detected binary path: /usr/bin/uwsgi-core Jul 06 15:16:22.090050 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: your processes number limit is 47680 Jul 06 15:16:22.090685 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: your memory page size is 4096 bytes Jul 06 15:16:22.090685 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: detected max file descriptor number: 2048 Jul 06 15:16:22.090685 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: lock engine: pthread robust mutexes Jul 06 15:16:22.090685 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: thunder lock: enabled Jul 06 15:16:22.090685 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 06 15:16:22.090685 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 15:16:22.133714 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: Python main interpreter initialized at 0x55c90122c9c0 Jul 06 15:16:22.133714 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: python threads support enabled Jul 06 15:16:22.133714 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: your server socket listen backlog is limited to 100 connections Jul 06 15:16:22.133714 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: your mercy for graceful operations on workers is 90 seconds Jul 06 15:16:22.134086 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 15:16:22.134162 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: *** Operational MODE: preforking *** Jul 06 15:16:22.134394 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: *** uWSGI is running in multiple interpreter mode *** Jul 06 15:16:22.134394 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: spawned uWSGI master process (pid: 103095) Jul 06 15:16:22.134591 dv-cinder-848848-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 06 15:16:22.135393 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: spawned uWSGI worker 1 (pid: 103096, cores: 1) Jul 06 15:16:22.135500 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: spawned uWSGI worker 2 (pid: 103097, cores: 1) Jul 06 15:16:22.136032 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 15:16:22.787658 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 15:16:22.788926 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 15:16:23.905575 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:16:23.905575 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: from cryptography.utils import int_from_bytes Jul 06 15:16:23.906165 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:16:23.906165 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: from cryptography.utils import int_from_bytes Jul 06 15:16:23.907406 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:16:23.907406 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: from cryptography.utils import int_from_bytes Jul 06 15:16:23.907824 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:16:23.907824 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: from cryptography.utils import int_from_bytes Jul 06 15:16:26.364371 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 15:16:26.364926 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 15:16:26.365153 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 15:16:26.365510 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 15:16:26.365762 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 15:16:26.366142 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.366462 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.366580 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 15:16:26.366929 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.367009 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 15:16:26.367098 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.367381 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 15:16:26.367486 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.367713 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.367798 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 15:16:26.367990 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 15:16:26.368089 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.368325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.368417 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.368648 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.368734 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.368905 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.368993 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.369215 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.369312 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.369533 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848848-4-iscsi {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.369648 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.369849 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.369935 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.370154 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.370252 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.370458 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.370558 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.370772 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.370858 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.371072 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.371165 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.371416 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.371517 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.371720 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.371806 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848848-4-iscsi {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.372054 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.372211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.372360 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.372649 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.372770 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.372952 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373056 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373260 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373363 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373588 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373684 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373895 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.373988 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.374196 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.374431 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.374543 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.374707 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.374814 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375014 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375123 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375347 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375451 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375682 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375810 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848848-4-iscsi {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.375994 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.376122 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.376302 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.376427 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.376620 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.376724 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.376929 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.377128 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.377251 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.377438 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.377560 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.377745 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.377952 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848848-4-iscsi {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378052 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378267 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378362 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378577 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378670 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378889 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.378984 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.379306 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.379412 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.379621 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.379707 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.379931 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380025 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380233 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380348 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380563 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380660 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380869 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.380978 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.381184 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.381474 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.381620 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.381773 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.381916 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382062 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382194 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382327 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382467 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382599 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382739 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.382902 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383044 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383252 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383360 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383489 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383648 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383743 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.383956 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384051 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384207 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384343 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384531 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384649 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384839 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.384960 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385163 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385257 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385486 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385586 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385739 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385833 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.385990 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.386134 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.386311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.386435 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.386632 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.386740 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.386943 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387037 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387270 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387378 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387582 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387678 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387890 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.387983 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.388201 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.388296 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.388511 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.388655 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.388819 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.388905 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.389128 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.389228 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.389448 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.389534 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.389763 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.389858 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.390083 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.390181 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.390396 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.390495 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.390708 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.390792 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391011 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391111 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391336 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391426 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391641 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391740 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.391956 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392043 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392284 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392378 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392584 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392670 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392832 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.392920 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.393126 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.393213 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.393427 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.393515 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.393739 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.393826 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394041 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394127 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394344 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394430 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394646 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394781 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.394947 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395041 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395265 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395374 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395568 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395667 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395869 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.395953 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.396687 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.396785 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.396991 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397079 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397376 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397687 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397891 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.397975 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.398189 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.398286 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.398491 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.398583 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.398799 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.398886 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.399099 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.399184 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.399428 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.399582 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.399729 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.399828 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400030 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400122 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400333 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400441 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400636 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400733 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.400935 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401021 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401251 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401347 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401553 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401640 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401855 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.401941 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.402158 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.402244 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.402466 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.402552 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.402760 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.402854 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.403068 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.403154 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.403385 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.403472 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.403688 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.403785 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404001 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404089 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404304 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404390 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404604 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404689 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.404904 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405044 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405189 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405321 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405493 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405635 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405844 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.405975 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406106 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406243 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406372 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406507 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406646 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406778 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.406946 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407096 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407258 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407400 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407569 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407699 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407865 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.407995 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.408165 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.408303 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.408467 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.408595 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.408771 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.408923 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.409059 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.409211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.409376 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.409505 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.409683 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.409816 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.409991 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.410134 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.410298 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.410428 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.410602 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.410767 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.410917 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:16:26.411064 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.411260 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.411406 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.411580 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.412259 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.412454 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.412587 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.412767 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.412896 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.413078 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.413211 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.413396 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.413794 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.413976 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.414113 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.414296 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.414439 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.414608 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.414741 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.414921 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.415063 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.415247 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.415410 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.415554 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.415701 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.415861 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416000 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416177 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416319 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416489 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416626 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416794 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.416925 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.417121 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.417259 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.417439 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.417581 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.417752 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.417881 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418061 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418200 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418375 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418511 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418681 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418813 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.418986 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.419126 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.419322 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.419456 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.419640 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.419774 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.419970 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.420108 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.420277 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.420407 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.420587 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.420673 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.420896 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421202 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421333 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421507 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421648 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421812 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.421943 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.422117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.422254 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.422444 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.422581 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.422751 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.422896 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.423062 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.423192 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.423393 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.423532 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.423707 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.423842 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424010 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424151 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424316 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424459 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424621 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424763 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424903 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.424993 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.425205 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.425343 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.425509 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.425653 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.425814 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.425949 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.426112 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.426260 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.426425 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.426559 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.426747 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.426881 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427045 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427188 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427392 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427522 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427700 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427841 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.427992 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.428127 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.428297 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.428434 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.428599 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.428734 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.428944 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429086 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429227 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429361 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429506 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429646 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429794 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.429925 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430198 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430362 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430493 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430663 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430809 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.430980 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.431133 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.431329 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.431481 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.431624 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.431759 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.431892 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432025 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432157 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432299 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432464 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432601 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432770 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.432908 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.433073 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.433211 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.433388 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.433523 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.433695 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.433837 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434001 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434145 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434316 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434444 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434629 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434760 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.434910 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435047 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435249 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435342 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435563 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435649 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435876 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.435969 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.436174 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.436260 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.436478 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.436572 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.436777 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.436865 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437074 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437161 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437370 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437671 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437759 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.437969 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438055 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438266 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438366 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438564 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438660 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438861 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.438953 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.439157 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.439274 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.439506 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.439595 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.439807 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.439931 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440103 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440200 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440399 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440486 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440698 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440792 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.440999 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.441143 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.441303 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.441434 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.441606 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.441737 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.441929 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442060 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442237 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442553 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442657 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442850 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.442960 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.443177 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.443316 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.443505 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.443590 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.443812 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.443902 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.444117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.444204 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.444424 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.444511 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.444739 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.444828 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445046 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445133 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445364 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445463 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445668 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445754 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.445984 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446071 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446288 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446388 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446598 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446697 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446897 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.446983 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.447206 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.447333 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.447540 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.447633 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.447860 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.447946 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.448170 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.448266 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.448483 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.448568 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.448789 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.448876 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.449098 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.449194 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.449402 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.449498 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.449707 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.449800 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450010 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450099 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450315 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450401 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450624 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450710 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.450930 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451053 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451259 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451351 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451564 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451650 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451879 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.451968 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.452183 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.452284 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.452495 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.452581 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.452793 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.452881 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.453100 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.453186 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.453408 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.453502 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.453732 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.453868 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454033 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454130 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454339 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454452 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454652 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454745 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.454954 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455062 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455281 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455391 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455590 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455690 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455889 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.455983 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.456204 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.456307 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.456506 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.456600 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.456812 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.456924 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.457117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.457219 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.457422 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.457509 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.457722 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.457807 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.458030 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.458118 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.458333 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.458427 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.459140 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.459290 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.459465 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.459554 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.459771 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.459858 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.460080 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.460166 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.460384 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.460469 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.460688 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.460772 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461001 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461097 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461303 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461397 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461601 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461691 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.461904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462001 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462210 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462307 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462510 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462597 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462808 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.462907 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.463107 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.463193 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.463467 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.463558 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.463772 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.463868 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464070 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464165 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464381 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464475 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464690 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464785 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.464991 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465136 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465295 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465403 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465599 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465697 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465904 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.465998 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.466218 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.466307 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.466526 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.466620 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.466830 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.466925 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.467137 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.467316 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.467467 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.467556 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.467771 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.467865 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468076 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468171 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468382 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468468 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468686 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468771 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.468992 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469088 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469297 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469383 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469691 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469900 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.469995 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.470208 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.470302 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.470522 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.470766 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.470853 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.471099 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.471187 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.471442 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.471544 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.471761 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.471846 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.472067 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.472158 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.472379 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.472466 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.472694 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.472790 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.473019 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.473267 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.473354 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.473606 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.473711 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.473926 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.474021 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.474776 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.474875 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.475082 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.475170 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.475425 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.475531 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.475733 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.475833 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476038 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476125 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476342 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476440 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476649 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476749 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.476947 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477042 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477246 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477333 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477546 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477637 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477845 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.477933 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.478154 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.478247 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.478452 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.478540 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.478758 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.478845 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479057 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479143 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479384 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479472 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479692 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479778 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.479991 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480086 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480292 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480379 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480678 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480896 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.480989 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.481210 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.481297 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.481517 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.481607 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.481841 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482007 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482151 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482238 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482458 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482544 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482756 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.482851 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483067 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483151 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483388 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483515 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483689 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483784 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.483986 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484079 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484593 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484681 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484890 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.484984 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.485196 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.485283 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.485500 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.485634 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.485812 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.485928 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.486117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.486230 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.486417 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.486521 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.486720 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.486815 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487017 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487120 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487349 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487444 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487651 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487746 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.487949 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488044 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488245 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488332 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488549 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488634 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488849 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.488944 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.489145 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.489239 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.489448 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.489532 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.489756 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.489848 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490073 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490167 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490379 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490525 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490667 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490810 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.490947 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491082 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491262 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491353 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491561 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491664 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491858 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.491952 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.492174 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.492266 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.492477 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.492577 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.492777 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.492871 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493076 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493177 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493378 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493474 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493673 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493767 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.493983 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494087 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494270 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494355 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494588 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494674 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494897 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.494991 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.495194 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.495290 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.495523 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.495611 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.495827 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.495928 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.496123 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.496217 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.496421 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.496506 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.496722 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.496816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497019 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497105 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497316 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497402 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497612 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497705 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497910 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.497995 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.498208 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.498295 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.498525 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.498618 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.498829 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.498913 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.499127 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.499210 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.499453 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.499539 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.499748 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.499833 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.500051 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.500134 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.500356 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.500450 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.500662 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.500755 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501026 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501127 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501292 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501376 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501599 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501774 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501901 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.501999 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.502204 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.502298 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.502512 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.502598 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.502810 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.502906 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.503117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.503203 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.503448 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.503548 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.503756 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.503853 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504054 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504150 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504353 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504440 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504669 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504757 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.504974 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.505061 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.505278 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.505383 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.505621 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.505725 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.505932 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506021 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506245 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506338 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506540 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506626 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506841 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.506925 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.507144 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.507243 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.507475 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.507563 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.507779 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.507873 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508081 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508174 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508384 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508469 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508688 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508774 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.508994 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.509092 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.509299 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.509391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.509602 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.509688 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.509902 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510065 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510206 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510299 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510508 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510594 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510805 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.510907 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.511117 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.511202 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.511443 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.511530 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.511745 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.511897 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512046 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512345 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512438 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512649 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512745 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.512947 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513043 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513255 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513353 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513584 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513673 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513897 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.513984 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.514205 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.514300 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.514516 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.514605 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.514817 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.514904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.515126 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.515251 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.515454 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.515550 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.515755 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.515878 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.516165 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.516273 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.516471 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.516559 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.516777 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.516864 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517081 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517177 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517378 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517466 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517674 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517762 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.517976 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.518073 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.518288 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.518382 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.518584 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.518705 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.518881 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519018 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519179 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519364 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519518 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519677 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519816 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.519984 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.520130 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.520289 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.520540 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.520628 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.520848 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.520936 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.521659 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.521771 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522013 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522109 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522318 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522406 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522642 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522729 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.522949 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523044 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523284 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523386 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523604 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523698 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523902 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.523998 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.524208 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.524295 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.524511 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.524704 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.524829 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525020 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525146 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525323 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525450 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525642 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525773 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.525968 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.526065 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.526293 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.526382 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.526601 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.526689 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.526917 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527004 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527236 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527339 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527572 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527658 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527897 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.527993 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.528209 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.528296 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.528524 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.528612 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.528828 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.528925 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.529153 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.529238 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.529453 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.529541 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.529757 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.529854 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530057 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530144 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530354 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530487 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530670 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530814 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.530967 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.531126 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.531293 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.531490 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.531595 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.531820 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.531908 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.532130 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.532229 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.532432 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.532535 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.532743 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.532831 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533045 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533131 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533353 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533447 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533659 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533745 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.533970 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534056 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534376 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534580 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534667 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534887 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.534975 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.535186 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.535292 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.535508 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.535595 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.535808 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.535904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.536106 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.536209 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.536428 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.536530 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.537274 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.537369 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.537588 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.537677 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.537911 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.538006 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.538233 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.538334 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.538798 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.538893 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.539125 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.539235 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.539457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.539560 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.539768 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.539864 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540076 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540172 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540395 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540490 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540695 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540790 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.540992 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541088 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541297 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541394 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541683 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541893 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.541979 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.542194 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.542302 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.542493 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.542604 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.542791 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.542887 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.543090 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.543202 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.543412 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.543555 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.543729 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.543861 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544029 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544169 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544345 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544483 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544648 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544790 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.544946 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.545096 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.545243 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.545402 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.545539 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.545712 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.545873 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546018 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546168 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546323 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546502 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546640 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546811 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.546940 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.547126 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.547248 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.547472 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.547574 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.547775 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.547882 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.548090 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.548177 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.548401 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.548496 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.548709 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.548796 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549018 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549111 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549327 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549427 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549635 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549723 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.549943 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550031 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550252 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550349 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550553 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550649 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550861 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.550947 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.551168 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.551274 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.551502 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.551603 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.551895 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.552014 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.552307 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.552460 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.552594 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.552735 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.552872 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553007 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553152 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553286 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553476 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553622 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553807 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.553973 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554105 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554259 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554395 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554528 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554693 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554834 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.554996 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.555245 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.555337 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.555576 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.555674 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.555896 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.555985 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.556215 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.556311 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.556529 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.556626 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.556845 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.556933 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.557158 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.557244 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.557467 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.557563 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.557775 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.557863 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.558089 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.558179 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.558397 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.558491 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.558704 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.558792 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559013 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559100 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559341 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559433 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559650 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559739 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.559956 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560055 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560263 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560352 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560568 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560663 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560873 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.560960 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.561176 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.561265 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.561482 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.561569 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.561788 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.561884 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.562106 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.562193 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.562436 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.562536 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.562750 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.562848 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.563058 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.563146 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.563391 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.563481 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.563703 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.563792 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564015 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564218 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564329 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564535 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564635 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564867 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.564955 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.565192 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.565328 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.565516 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.565613 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.565829 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.565916 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.566143 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.566231 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.566474 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.566578 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.566776 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.566866 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.567076 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.567175 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.567407 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.567626 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.567715 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.567971 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.568062 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.568309 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.568406 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.568623 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.568718 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.568924 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.569012 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.569239 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.569338 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.569545 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.569633 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.569873 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.570068 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.570165 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.570403 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.570490 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.570716 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.570803 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.571037 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.571137 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.571381 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.571469 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.571694 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.571780 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572000 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572129 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572305 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572419 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572608 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572703 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.572910 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.573014 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.573221 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.573449 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.573544 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.573794 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.573903 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.574100 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.574194 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.574406 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.574502 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.574708 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.574815 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575008 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575103 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575336 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575433 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575635 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575735 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.575957 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576045 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576259 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576357 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576560 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576665 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576859 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.576954 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.577165 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.577251 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.577467 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.577553 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.577764 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.577857 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578064 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578151 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578363 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578668 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578754 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.578965 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579059 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579292 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579382 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579593 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579681 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579898 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.579991 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.580194 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.580287 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.580497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.580583 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.580801 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.580897 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.581107 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.581193 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.581413 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.581504 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.581717 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.581816 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582030 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582116 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582335 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582428 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582648 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582822 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.582965 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.583103 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.583258 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.583348 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.584094 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.584204 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.584406 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.584494 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.584761 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.584990 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.585092 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.585323 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.585412 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.585640 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.585727 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.585969 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.586066 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.586282 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.586368 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.586589 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.586675 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.586899 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587007 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587198 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587353 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587538 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587626 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587842 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.587943 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.588146 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.588399 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.588488 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.588737 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.588839 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589037 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589125 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589341 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589435 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589643 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589739 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.589944 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590033 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590246 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590332 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590548 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590645 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590852 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.590947 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.591153 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.591259 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.591486 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.591576 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.591793 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.591880 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.592111 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.592205 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.592423 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.592512 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.592736 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.592834 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593043 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593129 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593353 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593442 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593657 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593751 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.593961 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594048 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594264 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594352 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594568 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594656 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594874 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.594968 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.595188 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.595304 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.595517 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.595603 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.595817 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.595918 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.596157 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.596244 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.596476 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.596564 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.596796 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.596907 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.597112 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.597219 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.597412 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.597498 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.597720 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.597813 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598030 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598119 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598333 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598426 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598647 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598735 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.598952 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.599047 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.599813 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.599912 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.600152 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.600240 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.600475 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.600575 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.600794 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.600891 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601094 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601182 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601393 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601480 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601691 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601791 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.601995 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.602082 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.602304 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.602391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.602607 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.602702 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.602904 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603003 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603196 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603314 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603520 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603616 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603818 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.603955 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.604114 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.604285 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.604408 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.604592 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.604705 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.604898 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605004 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605204 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605304 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605515 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605602 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605832 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.605920 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.606143 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.606240 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.606438 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.606523 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.606737 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.606871 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607037 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607138 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607362 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607451 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607662 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607748 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.607961 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608050 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608257 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608346 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608553 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608640 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608854 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.608942 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.609156 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.609251 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.609459 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.609546 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.609764 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.609852 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610069 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610156 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610372 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610472 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610670 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610756 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.610975 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.611060 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.611312 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.611431 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.611618 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.611715 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.611918 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612004 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612221 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612324 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612536 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612631 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612841 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.612942 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.613150 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.613248 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.613451 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.613538 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.613752 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.613839 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.614055 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.614144 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.614377 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.614472 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.614697 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.614782 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615017 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615103 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615356 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615447 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615669 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615769 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.615982 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.616070 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.616289 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.616376 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.616596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.616690 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.616910 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617058 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617219 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617351 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617520 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617665 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617830 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.617965 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.618117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.618252 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.618422 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.618568 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.618733 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.618865 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.619042 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.619176 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.619387 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.619479 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.619704 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.619799 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620006 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620093 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620316 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620411 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620633 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620719 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.620943 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621033 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621252 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621366 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621570 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621683 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621881 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.621987 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.622192 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.622289 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.622495 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.622590 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.622793 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.622897 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.623032 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 15:16:26.623136 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.623452 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.623762 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.624093 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.624418 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.624764 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.625078 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.625421 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.625749 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.626065 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.626378 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.626684 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:16:26.626928 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 15:16:26.687505 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Registered counter for database nova_api Jul 06 15:16:26.688816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Registered counter for database nova_api Jul 06 15:16:26.799380 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:26.801079 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:26.805769 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:26.807534 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:26.861740 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.context [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),817b0a4d-22b1-494d-b98d-37da4df0b98a(cell1) {{(pid=103096) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 15:16:26.864241 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.context [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),817b0a4d-22b1-494d-b98d-37da4df0b98a(cell1) {{(pid=103097) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 15:16:26.865703 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:16:26.867255 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:16:26.868063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:16:26.868187 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:16:26.869760 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:16:26.870118 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:16:26.870572 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:16:26.872081 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Registered counter for database nova_cell0 Jul 06 15:16:26.872685 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:16:26.874717 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Registered counter for database nova_cell0 Jul 06 15:16:26.875851 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Registered counter for database nova_cell1 Jul 06 15:16:26.878605 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Registered counter for database nova_cell1 Jul 06 15:16:26.886053 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:26.886807 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:26.888777 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:26.890046 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:26.893238 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:26.895790 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:26.897956 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:26.898292 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:27.042134 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Registered counter for database nova_cell0 Jul 06 15:16:27.045686 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Registered counter for database nova_cell0 Jul 06 15:16:27.050867 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:27.054745 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:16:27.055622 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:27.059083 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:16:27.391059 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:16:27.393454 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:16:27.398214 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:16:27.400824 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:16:27.737164 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:16:27.742600 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:16:27.743733 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:16:27.748669 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-a925d85c-3bdb-4a55-b9be-8fb30f648ddc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:16:27.748917 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c90122c9c0 pid: 103096 (default app) Jul 06 15:16:27.750942 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:16:27.752146 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Jul 06 15:16:27.752545 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Wed Jul 6 15:16:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:16:27.753828 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c90122c9c0 pid: 103097 (default app) Jul 06 15:17:42.244320 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:42.245428 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 06 15:17:42.245908 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:42.258426 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=3 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:42.259594 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell1:SELECT=3 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:42.260485 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell0:SELECT=3 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:42.261509 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:42.693205 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-f0671e00-19e0-48bd-80c1-de7e500eb978 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:42.722780 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-f0671e00-19e0-48bd-80c1-de7e500eb978 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469718 Jul 06 15:17:42.731618 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 6 15:17:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:17:44.781963 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:44.782957 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-842c30d3-fa20-4cde-9fb2-e0feb1812783 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jul 06 15:17:44.783404 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:44.848423 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-4fcc6a71-1bce-47a6-9414-353b3b1b715d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "ram": 256, "disk": 1}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:44.866023 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:17:44.866023 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: warnings.warn(msg) Jul 06 15:17:44.897657 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-4fcc6a71-1bce-47a6-9414-353b3b1b715d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107982 Jul 06 15:17:44.898205 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:17:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 15:17:44.912943 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:44.914285 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell1:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:44.915434 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell0:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:44.916348 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:45.123194 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-8ac06ebf-5a89-4adb-915d-12362845698b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:45.125615 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:17:45.125615 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: warnings.warn(msg) Jul 06 15:17:45.190463 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-8ac06ebf-5a89-4adb-915d-12362845698b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283438 Jul 06 15:17:45.191161 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 6 15:17:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:17:47.263165 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-4fcc6a71-1bce-47a6-9414-353b3b1b715d admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:47.264638 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-4fcc6a71-1bce-47a6-9414-353b3b1b715d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Jul 06 15:17:47.265478 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:47.384375 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-16bc3ed9-6107-461e-a82f-980b5091ed25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:47.401918 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:17:47.401918 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: warnings.warn(msg) Jul 06 15:17:47.420070 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-16bc3ed9-6107-461e-a82f-980b5091ed25 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147837 Jul 06 15:17:47.420626 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:17:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:47.432756 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-baaa9515-81f3-4689-84b6-848376626ac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:47.434313 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:17:47.434313 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: warnings.warn(msg) Jul 06 15:17:47.464713 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-baaa9515-81f3-4689-84b6-848376626ac4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035616 Jul 06 15:17:47.465258 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 6 15:17:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:17:49.519906 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-16bc3ed9-6107-461e-a82f-980b5091ed25 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:49.521467 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-16bc3ed9-6107-461e-a82f-980b5091ed25 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Jul 06 15:17:49.522273 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:49.586347 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-9800eeaa-5107-40b6-8add-1678300ee6b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:49.606663 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-9800eeaa-5107-40b6-8add-1678300ee6b8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077637 Jul 06 15:17:49.607635 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:17:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:49.619548 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-de279a03-d460-4b43-8560-e1ba13896afc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:49.645073 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-de279a03-d460-4b43-8560-e1ba13896afc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029183 Jul 06 15:17:49.646307 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 6 15:17:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:17:51.730863 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-9800eeaa-5107-40b6-8add-1678300ee6b8 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:51.733737 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-9800eeaa-5107-40b6-8add-1678300ee6b8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jul 06 15:17:51.739287 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:17:51.797342 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-d1ad495a-9633-4cac-a9ba-85bdd6ba05bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "disk": 10}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:51.815749 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-d1ad495a-9633-4cac-a9ba-85bdd6ba05bf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077933 Jul 06 15:17:51.816409 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:17:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 15:17:51.827944 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-c22e8142-31fe-4e53-b6c9-f16b956ec404 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:51.851234 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-c22e8142-31fe-4e53-b6c9-f16b956ec404 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026917 Jul 06 15:17:51.851920 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 6 15:17:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:17:53.945192 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-d1ad495a-9633-4cac-a9ba-85bdd6ba05bf admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:53.946204 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-d1ad495a-9633-4cac-a9ba-85bdd6ba05bf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 06 15:17:53.946599 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:54.010521 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-72548e4d-80de-4a15-a924-37d2a566a646 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:54.028091 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-72548e4d-80de-4a15-a924-37d2a566a646 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075550 Jul 06 15:17:54.028628 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:17:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:54.040676 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-08617f30-8ef2-41bf-a054-57c5e52fd97e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:54.062617 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-08617f30-8ef2-41bf-a054-57c5e52fd97e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025829 Jul 06 15:17:54.063166 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 6 15:17:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:17:56.135604 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-72548e4d-80de-4a15-a924-37d2a566a646 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:56.136606 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-72548e4d-80de-4a15-a924-37d2a566a646 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 06 15:17:56.136995 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:56.197350 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-113078da-4d23-4c25-96b4-e433490ac091 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:56.221495 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-113078da-4d23-4c25-96b4-e433490ac091 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078588 Jul 06 15:17:56.222112 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 6 15:17:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:17:58.299093 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-72548e4d-80de-4a15-a924-37d2a566a646 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:17:58.300902 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-72548e4d-80de-4a15-a924-37d2a566a646 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 06 15:17:58.304431 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:17:58.365327 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-693fc4c9-e4a3-453d-b735-8766a649904f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "id": "1"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:58.386127 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-693fc4c9-e4a3-453d-b735-8766a649904f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079633 Jul 06 15:17:58.386679 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:17:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:58.400233 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-fef5f077-fee3-44b5-934a-953a2cf67c42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:17:58.425980 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-fef5f077-fee3-44b5-934a-953a2cf67c42 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029965 Jul 06 15:17:58.427249 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 6 15:17:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:18:00.449785 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-693fc4c9-e4a3-453d-b735-8766a649904f admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:00.451128 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-693fc4c9-e4a3-453d-b735-8766a649904f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Jul 06 15:18:00.451715 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:00.521975 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-a976fc31-1639-4ac4-ad69-e78348acdf6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:00.540193 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-a976fc31-1639-4ac4-ad69-e78348acdf6e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082660 Jul 06 15:18:00.540764 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:18:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:00.553076 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-9a7d0657-d400-4cc2-a87d-20d789246880 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:00.576073 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-9a7d0657-d400-4cc2-a87d-20d789246880 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026351 Jul 06 15:18:00.576674 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 6 15:18:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:18:02.634134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-a976fc31-1639-4ac4-ad69-e78348acdf6e admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:02.635512 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-a976fc31-1639-4ac4-ad69-e78348acdf6e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Jul 06 15:18:02.636087 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:02.696835 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-ab3402c9-f6bd-4284-b8d7-a49ced0b1c04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:02.715980 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-ab3402c9-f6bd-4284-b8d7-a49ced0b1c04 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073462 Jul 06 15:18:02.716564 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:18:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:02.729689 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-2d2ef4ff-2fa6-4914-9043-8d6380f5cd6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:02.756070 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-2d2ef4ff-2fa6-4914-9043-8d6380f5cd6e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031124 Jul 06 15:18:02.756988 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 6 15:18:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:18:04.783766 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-ab3402c9-f6bd-4284-b8d7-a49ced0b1c04 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:04.784769 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-ab3402c9-f6bd-4284-b8d7-a49ced0b1c04 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 06 15:18:04.785159 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:04.841731 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-db881864-230c-4e0f-9ce2-2eb8f99b52b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:04.860835 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-db881864-230c-4e0f-9ce2-2eb8f99b52b2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069171 Jul 06 15:18:04.861376 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:18:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:04.873240 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-758cf372-71d1-4f36-a422-30ea240de603 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:04.896500 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-758cf372-71d1-4f36-a422-30ea240de603 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027197 Jul 06 15:18:04.897078 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 6 15:18:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:18:06.952757 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-db881864-230c-4e0f-9ce2-2eb8f99b52b2 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:06.955031 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-db881864-230c-4e0f-9ce2-2eb8f99b52b2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002572 Jul 06 15:18:06.955466 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:07.014397 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-f5405b0b-3123-4ed4-b62c-810da66ff6e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "id": "5", "vcpus": 8}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:07.032594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-f5405b0b-3123-4ed4-b62c-810da66ff6e1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070530 Jul 06 15:18:07.033158 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 6 15:18:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:07.045472 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-7fc0f4ac-1827-4ab9-b102-880393e7412c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:07.069028 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-7fc0f4ac-1827-4ab9-b102-880393e7412c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027234 Jul 06 15:18:07.069791 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 6 15:18:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:18:31.815076 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-f5405b0b-3123-4ed4-b62c-810da66ff6e1 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:31.816107 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-f5405b0b-3123-4ed4-b62c-810da66ff6e1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 06 15:18:31.816492 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:31.828220 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:31.876902 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-f4647ed6-27e1-4c3d-bf68-d20f14a4832c admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:31.894210 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-f4647ed6-27e1-4c3d-bf68-d20f14a4832c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071378 Jul 06 15:18:31.894721 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 6 15:18:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:18:32.795904 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-f5405b0b-3123-4ed4-b62c-810da66ff6e1 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:32.796904 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-f5405b0b-3123-4ed4-b62c-810da66ff6e1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 06 15:18:32.797292 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:32.983970 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-6d0e70af-e8df-4e44-88b7-db7c84ee7860 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:32.990100 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.wsgi [None req-6d0e70af-e8df-4e44-88b7-db7c84ee7860 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-6d0e70af-e8df-4e44-88b7-db7c84ee7860 admin admin] Request method failure captured: Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Accept: application/json Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Accept-Encoding: gzip, deflate Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Connection: keep-alive Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Content-Length: 0 Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Host: 10.222.0.46 Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Openstack-Api-Version: compute 2.90 Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Openstack-System-Scope: None Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: User-Agent: python-novaclient Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Auth-Token: gAAAAABixafIcDw_lCMOfzo8pAHTYGp_cuElT62PoTBW0Dk23KNAm8u0WL88nw6LRCQtPb9ulDQ_d25laEDC1eHYQmAFXSC9PUDATUUOqBlH-GijjjlFRDY7Rx9QgzHSnvNZkz2a2htbm9DbUrU_A-steKwaVMQd60Lr8_h3-i5ZIWdOJJLr9jE Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Domain-Id: None Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Domain-Name: None Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Identity-Status: Confirmed Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Is-Admin-Project: True Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Domain-Id: default Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Domain-Name: Default Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Name: admin Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Role: member,reader,admin Jul 06 15:18:32.993385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Roles: member,reader,admin Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b898c8312f89416b8b105c391af48831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b898c8312f89416b8b105c391af48831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant: admin Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant-Name: admin Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User: admin Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Domain-Id: default Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Domain-Name: Default Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Id: d82646fafad44bd489ae80854728f595 Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Name: admin Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: method: > Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: exception: Flavor 42 could not be found. Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: action_args: {'id': '42'} Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:18:32.995032 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:32.996391 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:32.998311 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-6d0e70af-e8df-4e44-88b7-db7c84ee7860 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:18:33.000009 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-6d0e70af-e8df-4e44-88b7-db7c84ee7860 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060699 Jul 06 15:18:33.000009 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 6 15:18:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:33.004772 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-ff07f1e8-3580-4180-a5de-7e39d9c6f602 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:33.007786 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:33.027466 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-ff07f1e8-3580-4180-a5de-7e39d9c6f602 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026258 Jul 06 15:18:33.028002 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 6 15:18:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:18:33.038550 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-22ef8c0a-2695-4e6a-92c1-380c194b1f27 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:33.059165 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-22ef8c0a-2695-4e6a-92c1-380c194b1f27 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024389 Jul 06 15:18:33.059712 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 6 15:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:18:33.068887 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-fef69076-736f-4fbb-b054-5a67f6dadf5d admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:33.075055 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.wsgi [None req-fef69076-736f-4fbb-b054-5a67f6dadf5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-fef69076-736f-4fbb-b054-5a67f6dadf5d admin admin] Request method failure captured: Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Accept: application/json Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Accept-Encoding: gzip, deflate Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Connection: keep-alive Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Content-Length: 0 Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Host: 10.222.0.46 Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Openstack-Api-Version: compute 2.90 Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Openstack-System-Scope: None Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: User-Agent: python-novaclient Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Auth-Token: gAAAAABixafIcDw_lCMOfzo8pAHTYGp_cuElT62PoTBW0Dk23KNAm8u0WL88nw6LRCQtPb9ulDQ_d25laEDC1eHYQmAFXSC9PUDATUUOqBlH-GijjjlFRDY7Rx9QgzHSnvNZkz2a2htbm9DbUrU_A-steKwaVMQd60Lr8_h3-i5ZIWdOJJLr9jE Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Domain-Id: None Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Domain-Name: None Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Identity-Status: Confirmed Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Is-Admin-Project: True Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Domain-Id: default Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Domain-Name: Default Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Name: admin Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Role: member,reader,admin Jul 06 15:18:33.078325 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Roles: member,reader,admin Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b898c8312f89416b8b105c391af48831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b898c8312f89416b8b105c391af48831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant: admin Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant-Name: admin Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User: admin Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Domain-Id: default Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Domain-Name: Default Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Id: d82646fafad44bd489ae80854728f595 Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Name: admin Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: method: > Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: exception: Flavor 42 could not be found. Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: action_args: {'id': '42'} Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:18:33.080282 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:33.081138 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:33.082211 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-fef69076-736f-4fbb-b054-5a67f6dadf5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:18:33.083243 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-fef69076-736f-4fbb-b054-5a67f6dadf5d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014910 Jul 06 15:18:33.083243 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 6 15:18:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:33.893505 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-22ef8c0a-2695-4e6a-92c1-380c194b1f27 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:33.894518 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-22ef8c0a-2695-4e6a-92c1-380c194b1f27 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 06 15:18:33.894907 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:34.084327 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-81edb5d3-c05e-45f6-ac10-510d80214057 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:34.089557 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.wsgi [None req-81edb5d3-c05e-45f6-ac10-510d80214057 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-81edb5d3-c05e-45f6-ac10-510d80214057 admin admin] Request method failure captured: Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Accept: application/json Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Accept-Encoding: gzip, deflate Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Connection: keep-alive Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Content-Length: 0 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Host: 10.222.0.46 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Openstack-Api-Version: compute 2.90 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Openstack-System-Scope: None Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: User-Agent: python-novaclient Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Auth-Token: gAAAAABixafJmQQdO6gd7M4LDwnWV2gtWpVdJte8-LJ3mQBvRsjOH2XcICwhlus2WE_f-C6D_4_vSeesJQaURMlQUW5iJDDslQz531yc-PEgeR4_hw6dFQKQeXbjwN_alXdeT0sX9FIhKfOGkGtOFjJwEscpoHwyeKoqyXJ3h_EV-DI0_uxyeQ0 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Domain-Id: None Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Domain-Name: None Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Identity-Status: Confirmed Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Is-Admin-Project: True Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Domain-Id: default Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Domain-Name: Default Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Name: admin Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Role: member,reader,admin Jul 06 15:18:34.091063 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Roles: member,reader,admin Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b898c8312f89416b8b105c391af48831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b898c8312f89416b8b105c391af48831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant: admin Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant-Name: admin Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User: admin Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Domain-Id: default Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Domain-Name: Default Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Id: d82646fafad44bd489ae80854728f595 Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Name: admin Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: method: > Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: exception: Flavor 84 could not be found. Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: action_args: {'id': '84'} Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:18:34.092497 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:34.093290 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.094592 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-81edb5d3-c05e-45f6-ac10-510d80214057 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:18:34.095958 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-81edb5d3-c05e-45f6-ac10-510d80214057 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060393 Jul 06 15:18:34.095958 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 6 15:18:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:34.102221 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-29ea2e45-20c9-47c8-9a7e-41aad1b4c54c admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:34.116226 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-29ea2e45-20c9-47c8-9a7e-41aad1b4c54c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017630 Jul 06 15:18:34.116744 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 6 15:18:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:18:34.126424 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-6da847b1-c573-46a2-888b-e3996239e429 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:34.139885 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-6da847b1-c573-46a2-888b-e3996239e429 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017546 Jul 06 15:18:34.140407 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 6 15:18:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:18:34.149182 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-2de7056a-9106-4e3d-8e2f-cc4c96d82e97 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:34.154356 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.wsgi [None req-2de7056a-9106-4e3d-8e2f-cc4c96d82e97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-2de7056a-9106-4e3d-8e2f-cc4c96d82e97 admin admin] Request method failure captured: Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Accept: application/json Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Accept-Encoding: gzip, deflate Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Connection: keep-alive Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Content-Length: 0 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Host: 10.222.0.46 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Openstack-Api-Version: compute 2.90 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Openstack-System-Scope: None Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: User-Agent: python-novaclient Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Auth-Token: gAAAAABixafJmQQdO6gd7M4LDwnWV2gtWpVdJte8-LJ3mQBvRsjOH2XcICwhlus2WE_f-C6D_4_vSeesJQaURMlQUW5iJDDslQz531yc-PEgeR4_hw6dFQKQeXbjwN_alXdeT0sX9FIhKfOGkGtOFjJwEscpoHwyeKoqyXJ3h_EV-DI0_uxyeQ0 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Domain-Id: None Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Domain-Name: None Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Identity-Status: Confirmed Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Is-Admin-Project: True Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Domain-Id: default Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Domain-Name: Default Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Name: admin Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Role: member,reader,admin Jul 06 15:18:34.155904 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Roles: member,reader,admin Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b898c8312f89416b8b105c391af48831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b898c8312f89416b8b105c391af48831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant: admin Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant-Name: admin Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User: admin Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Domain-Id: default Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Domain-Name: Default Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Id: d82646fafad44bd489ae80854728f595 Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Name: admin Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: method: > Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: exception: Flavor 84 could not be found. Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: action_args: {'id': '84'} Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:18:34.157816 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:34.158615 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:34.160457 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-2de7056a-9106-4e3d-8e2f-cc4c96d82e97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:18:34.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-2de7056a-9106-4e3d-8e2f-cc4c96d82e97 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012035 Jul 06 15:18:34.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 6 15:18:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:34.972623 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-6da847b1-c573-46a2-888b-e3996239e429 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:34.973620 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-6da847b1-c573-46a2-888b-e3996239e429 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 06 15:18:34.974010 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:35.161792 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-106480b5-26be-4b2c-b17b-a73c96a12e95 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:35.167577 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.wsgi [None req-106480b5-26be-4b2c-b17b-a73c96a12e95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-106480b5-26be-4b2c-b17b-a73c96a12e95 admin admin] Request method failure captured: Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Accept: application/json Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Accept-Encoding: gzip, deflate Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Connection: keep-alive Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Content-Length: 0 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Host: 10.222.0.46 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Openstack-Api-Version: compute 2.90 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Openstack-System-Scope: None Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: User-Agent: python-novaclient Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Auth-Token: gAAAAABixafKPpKG4sMLEDspT9DPNXOF--V-5iZkD0ggjNZxsGjVZO8-c9uVsruTvC530HPjGCPh5B57MkwiPdUQYL2J_EkAjIk374D4LaqbbD1dtyfQQr5bOKFaxTLPT-NI6KVzHwosZnu-MxmbF_ddOJIrjdNUtwaGILcLB2MowUciWPxoZv0 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Domain-Id: None Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Domain-Name: None Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Identity-Status: Confirmed Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Is-Admin-Project: True Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Domain-Id: default Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Domain-Name: Default Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Project-Name: admin Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Role: member,reader,admin Jul 06 15:18:35.169074 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Roles: member,reader,admin Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b898c8312f89416b8b105c391af48831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b898c8312f89416b8b105c391af48831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant: admin Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-Tenant-Name: admin Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User: admin Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Domain-Id: default Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Domain-Name: Default Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Id: d82646fafad44bd489ae80854728f595 Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: X-User-Name: admin Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: method: > Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: exception: Flavor 451 could not be found. Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: action_args: {'id': '451'} Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:18:35.170654 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:35.171671 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.173134 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-106480b5-26be-4b2c-b17b-a73c96a12e95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:18:35.174338 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-106480b5-26be-4b2c-b17b-a73c96a12e95 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059602 Jul 06 15:18:35.174534 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 6 15:18:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:35.179774 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-366217f3-5fc7-41d9-8306-bbd24b7fcbbb admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:35.193710 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-366217f3-5fc7-41d9-8306-bbd24b7fcbbb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017415 Jul 06 15:18:35.194233 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 6 15:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:18:35.203203 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:35.218248 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018393 Jul 06 15:18:35.218755 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 6 15:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:18:35.227846 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-0899f3b3-72ed-4961-a79c-e18858f66c1e admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:35.233229 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.wsgi [None req-0899f3b3-72ed-4961-a79c-e18858f66c1e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-0899f3b3-72ed-4961-a79c-e18858f66c1e admin admin] Request method failure captured: Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Accept: application/json Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Accept-Encoding: gzip, deflate Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Connection: keep-alive Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Content-Length: 0 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Host: 10.222.0.46 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Openstack-Api-Version: compute 2.90 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Openstack-System-Scope: None Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: User-Agent: python-novaclient Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Auth-Token: gAAAAABixafKPpKG4sMLEDspT9DPNXOF--V-5iZkD0ggjNZxsGjVZO8-c9uVsruTvC530HPjGCPh5B57MkwiPdUQYL2J_EkAjIk374D4LaqbbD1dtyfQQr5bOKFaxTLPT-NI6KVzHwosZnu-MxmbF_ddOJIrjdNUtwaGILcLB2MowUciWPxoZv0 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Domain-Id: None Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Domain-Name: None Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Identity-Status: Confirmed Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Is-Admin-Project: True Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Openstack-Nova-Api-Version: 2.90 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Domain-Id: default Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Domain-Name: Default Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Project-Name: admin Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Role: member,reader,admin Jul 06 15:18:35.235224 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Roles: member,reader,admin Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b898c8312f89416b8b105c391af48831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b898c8312f89416b8b105c391af48831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b898c8312f89416b8b105c391af48831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant: admin Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant-Id: b898c8312f89416b8b105c391af48831 Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-Tenant-Name: admin Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User: admin Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Domain-Id: default Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Domain-Name: Default Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Id: d82646fafad44bd489ae80854728f595 Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: X-User-Name: admin Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: method: > Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: exception: Flavor 451 could not be found. Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: action_args: {'id': '451'} Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:18:35.236596 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:35.237405 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Jul 06 15:18:35.238594 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-0899f3b3-72ed-4961-a79c-e18858f66c1e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:18:35.239884 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-0899f3b3-72ed-4961-a79c-e18858f66c1e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012251 Jul 06 15:18:35.239884 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 6 15:18:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:36.068605 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:36.069590 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jul 06 15:18:36.069969 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:36.254615 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-d410e0b9-b3b0-4865-ada8-d76355251c46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:36.273197 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-d410e0b9-b3b0-4865-ada8-d76355251c46 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069837 Jul 06 15:18:36.273722 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 6 15:18:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:37.080271 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:37.081264 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Jul 06 15:18:37.081651 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:37.269356 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-b44f0b8f-fc0a-44d2-afbb-f86978206fce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:37.286758 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-b44f0b8f-fc0a-44d2-afbb-f86978206fce admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069278 Jul 06 15:18:37.287312 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 6 15:18:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:38.100580 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:38.101579 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 06 15:18:38.101976 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:38.295849 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-84cde8de-4446-49e8-bb54-5700b957b6ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:38.313296 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-84cde8de-4446-49e8-bb54-5700b957b6ed admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074767 Jul 06 15:18:38.313764 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 6 15:18:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:39.124877 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:39.126438 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Jul 06 15:18:39.126830 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:39.312172 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-5cab4d60-df5e-4b61-8223-3a8fb2610cfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:18:39.331384 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-5cab4d60-df5e-4b61-8223-3a8fb2610cfb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069479 Jul 06 15:18:39.331899 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 6 15:18:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:18:40.150481 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:40.151510 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 06 15:18:40.151897 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:18:40.337649 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-38017591-7414-4695-9ef8-25d03fbdee4a admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:18:40.356287 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-38017591-7414-4695-9ef8-25d03fbdee4a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069310 Jul 06 15:18:40.356802 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Wed Jul 6 15:18:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:19:26.130389 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:19:26.131435 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-1cbdfa82-30e8-4f2b-911b-1b9436ee1ddd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Jul 06 15:19:26.131821 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 6 15:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:19:26.142065 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:26.190998 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-78837706-b084-443d-b10e-0eb15d4ec745 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:19:26.209591 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-78837706-b084-443d-b10e-0eb15d4ec745 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071947 Jul 06 15:19:26.210117 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 6 15:19:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:19:26.232822 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-599cada9-bd61-4104-955e-8c6933990c80 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:19:26.236909 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=14 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:26.242860 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-599cada9-bd61-4104-955e-8c6933990c80 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013564 Jul 06 15:19:26.243439 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Wed Jul 6 15:19:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:19:26.254947 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-71ec79ce-6850-4276-beec-0ae4815fb25a admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:19:26.262626 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-71ec79ce-6850-4276-beec-0ae4815fb25a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011230 Jul 06 15:19:26.263115 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Wed Jul 6 15:19:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:19:26.275052 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:19:26.283169 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011758 Jul 06 15:19:26.283701 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Wed Jul 6 15:19:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:19:26.294637 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-d1c83029-eba5-4fde-8500-75ffe05d7e2f admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:19:26.302002 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-d1c83029-eba5-4fde-8500-75ffe05d7e2f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010759 Jul 06 15:19:26.302495 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Wed Jul 6 15:19:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:22:37.634644 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:37.635693 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 06 15:22:37.636077 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:22:37.774003 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=6 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:37.884841 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-81c9f20f-75c3-4500-ab51-8e4dcb2071d7 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:37.886000 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:37.886000 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: warnings.warn(msg) Jul 06 15:22:37.887187 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-81c9f20f-75c3-4500-ab51-8e4dcb2071d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:37.887644 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-81c9f20f-75c3-4500-ab51-8e4dcb2071d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:37.888409 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-81c9f20f-75c3-4500-ab51-8e4dcb2071d7 admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:37.888828 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-81c9f20f-75c3-4500-ab51-8e4dcb2071d7 admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:37.922795 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-81c9f20f-75c3-4500-ab51-8e4dcb2071d7 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150255 Jul 06 15:22:37.923356 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 6 15:22:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:22:38.755933 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:38.757001 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 06 15:22:38.757385 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:22:38.946621 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-fbd2135a-b3c3-4a7d-962d-dd8f561e96f3 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:38.947816 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:38.947816 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: warnings.warn(msg) Jul 06 15:22:38.949149 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-fbd2135a-b3c3-4a7d-962d-dd8f561e96f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:38.949581 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-fbd2135a-b3c3-4a7d-962d-dd8f561e96f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:38.950352 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-fbd2135a-b3c3-4a7d-962d-dd8f561e96f3 admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:38.950765 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-fbd2135a-b3c3-4a7d-962d-dd8f561e96f3 admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:38.969742 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-fbd2135a-b3c3-4a7d-962d-dd8f561e96f3 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074117 Jul 06 15:22:38.970213 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 6 15:22:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:22:50.207519 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:50.208526 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 06 15:22:50.208917 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:22:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:22:50.349524 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell0:SELECT=4 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:50.350236 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell1:SELECT=4 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:50.350861 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=8 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:50.398272 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-e130f42c-fd39-4b75-bee3-f02d8e64d479 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:50.399516 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:50.399516 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: warnings.warn(msg) Jul 06 15:22:50.400684 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e130f42c-fd39-4b75-bee3-f02d8e64d479 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:50.401122 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e130f42c-fd39-4b75-bee3-f02d8e64d479 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:50.401930 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e130f42c-fd39-4b75-bee3-f02d8e64d479 admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:50.402351 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e130f42c-fd39-4b75-bee3-f02d8e64d479 admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:50.427631 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-e130f42c-fd39-4b75-bee3-f02d8e64d479 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082456 Jul 06 15:22:50.428103 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 6 15:22:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:22:51.248854 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:51.250498 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-82ab3667-2593-411a-900b-9fa3afda003a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Jul 06 15:22:51.250840 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 6 15:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:22:51.438668 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-9f9d2bfa-fd8f-4453-a746-d22d98c53f7d admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:22:51.439878 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:51.439878 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: warnings.warn(msg) Jul 06 15:22:51.441098 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-9f9d2bfa-fd8f-4453-a746-d22d98c53f7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:51.441533 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-9f9d2bfa-fd8f-4453-a746-d22d98c53f7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:51.442311 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-9f9d2bfa-fd8f-4453-a746-d22d98c53f7d admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:22:51.442761 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-9f9d2bfa-fd8f-4453-a746-d22d98c53f7d admin admin] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:22:51.463933 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-9f9d2bfa-fd8f-4453-a746-d22d98c53f7d admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076423 Jul 06 15:22:51.464462 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 6 15:22:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:23:47.282968 dv-cinder-848848-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 06 15:23:47.283943 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: Wed Jul 6 15:23:47 2022 - graceful shutdown triggered... Jul 06 15:23:47.284907 dv-cinder-848848-4-iscsi devstack@n-api.service[103096]: Gracefully killing worker 1 (pid: 103096)... Jul 06 15:23:47.287273 dv-cinder-848848-4-iscsi devstack@n-api.service[103097]: Gracefully killing worker 2 (pid: 103097)... Jul 06 15:23:48.284867 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: worker 1 buried after 1 seconds Jul 06 15:23:48.285294 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: worker 2 buried after 1 seconds Jul 06 15:23:48.285294 dv-cinder-848848-4-iscsi devstack@n-api.service[103095]: goodbye to uWSGI. Jul 06 15:23:48.286434 dv-cinder-848848-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 06 15:23:48.286982 dv-cinder-848848-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 06 15:23:48.289793 dv-cinder-848848-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 06 15:23:48.302694 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 15:23:48 2022] *** Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: nodename: dv-cinder-848848-4-iscsi Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: machine: x86_64 Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: clock source: unix Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: pcre jit disabled Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: detected number of CPU cores: 4 Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: current working directory: / Jul 06 15:23:48.304749 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: detected binary path: /usr/bin/uwsgi-core Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: your processes number limit is 47680 Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: your memory page size is 4096 bytes Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: detected max file descriptor number: 2048 Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: lock engine: pthread robust mutexes Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: thunder lock: enabled Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 06 15:23:48.305524 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 15:23:48.349048 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: Python main interpreter initialized at 0x55de482c89c0 Jul 06 15:23:48.349048 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: python threads support enabled Jul 06 15:23:48.349048 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: your server socket listen backlog is limited to 100 connections Jul 06 15:23:48.349048 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: your mercy for graceful operations on workers is 90 seconds Jul 06 15:23:48.349492 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 15:23:48.349492 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: *** Operational MODE: preforking *** Jul 06 15:23:48.349790 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: *** uWSGI is running in multiple interpreter mode *** Jul 06 15:23:48.349790 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: spawned uWSGI master process (pid: 117601) Jul 06 15:23:48.349992 dv-cinder-848848-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 06 15:23:48.353009 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: spawned uWSGI worker 1 (pid: 117619, cores: 1) Jul 06 15:23:48.353346 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: spawned uWSGI worker 2 (pid: 117620, cores: 1) Jul 06 15:23:48.353508 dv-cinder-848848-4-iscsi devstack@n-api.service[117601]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 15:23:49.006498 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 15:23:49.023043 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 06 15:23:50.194334 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:23:50.194334 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: from cryptography.utils import int_from_bytes Jul 06 15:23:50.194979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:23:50.194979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: from cryptography.utils import int_from_bytes Jul 06 15:23:50.223566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:23:50.223566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: from cryptography.utils import int_from_bytes Jul 06 15:23:50.224125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:23:50.224125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: from cryptography.utils import int_from_bytes Jul 06 15:23:52.500748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 15:23:52.501282 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 15:23:52.501555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 15:23:52.501822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 15:23:52.502083 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 15:23:52.502479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.503491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.503863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.504193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.504533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.504852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.505183 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.505512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.505846 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.506115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.506436 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.506799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848848-4-iscsi {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.507103 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.507447 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.507768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.508092 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.508403 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.508735 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.509047 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.509553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.510969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.510969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.510969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.511423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.511608 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.511892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.512226 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.512556 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.512884 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.513203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.513625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848848-4-iscsi {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.513953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.514275 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.514600 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.515017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.515362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.515681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.516011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.516343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.516660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.516998 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.517349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.517653 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.517986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.518295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.519287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.519287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.519607 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.519935 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.520254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.520513 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.520830 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.521164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.521495 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.521826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.522085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.522342 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.522670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.523001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.523345 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.523665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.523981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.524296 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.524611 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.524926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.525242 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.525555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.525882 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.526205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.526534 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.526856 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.527182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.527617 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.527876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.528192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.528540 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.528867 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.529184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.529514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.529842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.530157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.530470 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.530782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.531676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.531676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.531865 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 15:23:52.532258 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.532345 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 15:23:52.532430 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.532430 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.532580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 15:23:52.532809 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.532969 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 15:23:52.533125 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.533278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 15:23:52.533688 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.533843 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534201 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.534991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.535146 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.535326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.535487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.535640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.535785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.535938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.536082 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.536225 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.536448 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.536614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.536768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.536955 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.537112 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.537266 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.537579 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848848-4-iscsi {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.537744 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.537901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.537901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.538183 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.538345 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.538503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.538671 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.538671 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.538958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.539108 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.539637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.539912 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.540215 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.540522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.540857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.541166 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.541592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.541776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.542655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.542826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.542985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.543140 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.543353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.543517 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.543730 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.543892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.544038 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848848-4-iscsi {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.544189 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.544375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.544537 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.544732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.544898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545050 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545194 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545338 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.545996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.546148 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.546319 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.546510 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.546666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.546865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.547026 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.547171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.547461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.547882 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.548033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.548179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.548323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.548468 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.548660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.548810 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.549019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.549170 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.549296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.549414 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.549537 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.550446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.550605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.553374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554172 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554345 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554817 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.554937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.555049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.555159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.555159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.555159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.555739 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.555900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556054 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556783 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.556943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.557225 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.557400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.557553 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.557730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.558080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.559968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.559968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.560258 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.560701 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.560893 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.561019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.561142 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.561265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.561265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.561491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.561491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.561715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.561827 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.561981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.562109 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.562232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.562344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.562454 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.562565 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.562855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.563045 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.563354 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.563529 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.563688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.563842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.564003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.564155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.564300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.564450 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.564594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.564749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.564957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.565158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.565376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.566032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.566188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.566332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.566490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.566641 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.566794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.566974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.567124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.567338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.567492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.567644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.567798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.567969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.568290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.568290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.568557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.568700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.568700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.569637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.569798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.569955 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.570112 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.570256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.570399 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.570568 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.570794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.570959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.571151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.571330 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.571601 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.571764 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.571910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.572070 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.572216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.572358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.572501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.572643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.572800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.572944 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.573108 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.573324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.573610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.573770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.573922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.574066 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.574217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.574369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.574514 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.574656 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.574810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.574954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.575141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.575358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.575549 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.575706 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.575858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.575858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.576138 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.576292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.576442 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.576594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.576751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.576904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.577055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.577205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.577377 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.577557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.577707 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.577850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.577992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.578134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.578468 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.578629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.578783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.578935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.579087 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.579368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.579368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.579707 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.579864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.580009 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.580153 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.580305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.580452 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.581305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.581478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.581756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.581917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.582071 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.582235 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.582393 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.582539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.582682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.583382 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.583559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.583763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:23:52.583946 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.584141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.584300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.584446 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.584592 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.584743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.584916 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585061 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585348 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585810 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.585961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.586113 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.586113 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.586403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.586557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.586713 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.586863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587006 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587149 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587496 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.587981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.588133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.588276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.588617 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.588779 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.588935 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.589088 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.589241 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.589394 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.589546 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.589739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.589896 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590656 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.590961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.591112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.591299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.591562 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.591713 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.591974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.592137 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.592282 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.592436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.592588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.592732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.592887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593800 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.593944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.594097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.594242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.594386 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.594538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.594681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.594832 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.595000 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.595154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.595378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.595535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.595688 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.595874 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.596063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.596214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.596359 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.596603 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.596790 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.596938 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.597096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.597263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.597415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.597566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.597710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.597911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.598063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.598216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.598368 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.598537 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.598781 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.598946 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.599092 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.599264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.599426 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.599606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.599771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.599771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600073 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600518 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600667 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600820 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.600972 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.601122 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.601283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.601435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.601752 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.601928 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.602188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.602356 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.602513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.602656 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.602809 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.602961 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.603105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.603105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.603440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.603608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.603770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.603958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.604116 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.604261 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.604404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.604548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.604701 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.604864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605010 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.605986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606531 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.606946 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607141 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607562 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607698 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607792 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.607885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608106 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608201 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608643 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608899 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.608992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609477 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609564 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.609981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610345 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610794 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.610926 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611465 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611652 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.611920 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.612631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.612737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.612825 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613404 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613773 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613861 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.613947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614156 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614268 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614641 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614827 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.614922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615430 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615530 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615802 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615896 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.615989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616083 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616170 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616659 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.616967 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.617187 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.617317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.617516 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.617625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.617835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.617936 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.618149 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.618295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.618463 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.618585 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.618764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.618866 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.619080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.619196 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.619423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.619541 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.619752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.619855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.620067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.620176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.620381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.620483 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.620694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.620789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621003 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621311 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621403 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.621935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.622212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.622305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.622552 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.622864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.623182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.623399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.623513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.623733 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.623838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.624068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.624169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.624411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.624518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.624749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.624850 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.625055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.625179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.625377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.625524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.625705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627477 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.627743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628418 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628902 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.628977 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629057 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629137 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629210 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629282 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629367 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629657 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629874 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.629965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.630177 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.630286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.630493 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.630593 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.630801 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.630894 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.631102 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.631282 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632391 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632488 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632578 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632661 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632745 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.632923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633027 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633200 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633455 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633527 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.633860 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.634065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.634158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.634520 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.634628 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.634742 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.634831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635638 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635833 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.635928 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.636957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.637168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.637268 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.637474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.637568 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.637779 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.637873 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.638099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.638219 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.638409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.638502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.638714 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.638809 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639471 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639780 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.639990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.640098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.640308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.640407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.640614 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.640717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.640921 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641027 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641328 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641530 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641632 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641837 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.641939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.642143 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.642236 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.642456 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.642711 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.642814 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.643041 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.643135 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.643417 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.643519 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.643729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.643840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644453 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644795 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.644984 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.645091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.645317 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.645435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.645622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.645735 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.645922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646629 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646837 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.646929 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.647139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.647261 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.647466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.647560 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.647770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.647878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648170 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648478 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648780 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.648982 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.649991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.650205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.650306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.650508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.650610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.650814 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.650907 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.651125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.651272 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.651462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.651568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.651762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.651854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.652064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.652158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.652397 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.652489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.652698 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.652790 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653656 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.653980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.654073 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.654287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.654381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.654610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.654724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.654917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655268 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655645 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655847 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.655954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.656153 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.656246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.656454 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.656547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.656762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.656924 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657163 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657374 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.657983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.658078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.658289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.658630 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.658842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.658936 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.659691 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.659788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660398 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660699 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.660912 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661219 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661314 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661622 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661826 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.661928 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.662129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.662223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.662442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.662542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.662744 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.662851 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663044 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663465 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.663984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.664086 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.664285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.664387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.664596 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.664765 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.664904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.665914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.666115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.666219 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.666413 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.666515 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.666719 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.666812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667024 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667358 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667511 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667837 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.667973 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.668156 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.668263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.668468 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.668563 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.668785 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.668879 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.669101 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.669204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.669421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.669517 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.669717 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.669809 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670017 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670447 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670615 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.670936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.671067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.671318 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.671419 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.671627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.671730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.671928 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672230 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672335 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672663 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672867 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.672964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.673186 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.673279 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.673492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.673600 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.673807 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.673898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.674117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.674217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.674425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.674526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.675310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.675434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.675625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.675765 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.676097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.676221 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.676466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.676560 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.676784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.676879 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.677100 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.677204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.677405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.677497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.677709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.677809 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678028 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.678960 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.679061 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.679304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.679402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.679627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.679721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.679929 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680024 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680234 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680329 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680540 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680641 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680844 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.680947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.681152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.681253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.681459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.681559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.681767 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.681860 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682075 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682690 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.682996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.683150 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.683321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.683524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.683619 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.683838 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.683931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.684149 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.684243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.684462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.684564 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.684771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.684864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.685989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.686095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.686291 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.686395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.686609 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.686702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.686918 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687258 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687356 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687685 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687893 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.687988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.688200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.688300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.688512 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.688615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.688822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.688922 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.689129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.689229 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.689446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.689547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.689775 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.689876 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.690088 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.690189 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.690428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.690536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.690735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.690834 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691139 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691684 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.691985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.692078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.692284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.692385 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.692583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.692677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.692900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.693001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.693199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.693300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.693514 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.693609 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.693921 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694057 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694321 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694531 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694850 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.694956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.695158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.695302 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.695533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.695647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.695804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.695950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.696115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.696209 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.696428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.696533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.696740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.696849 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697140 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697446 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.697981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698598 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.698994 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.699231 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.699339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.699553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.699657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.699859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.699951 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.700178 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.700270 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.700496 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.700589 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.700834 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.700934 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.701164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.701286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.701494 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.701637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.701810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.701911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.702115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.702238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.702418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.702519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.702724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.702821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703027 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703130 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.703976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.704084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.704285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.704387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.704591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.704695 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.704900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705003 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705201 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.705954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.706148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.706394 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.706511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.706732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.706852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.707049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.707152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.707395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.707492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.707697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.707799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708120 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708430 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708733 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.708929 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709236 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.709962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.710182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.710277 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.710513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.710608 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.710840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.710935 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.711152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.711266 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.711503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.711606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.711824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.711955 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.712137 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.712244 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.712453 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.712554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.712773 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.712866 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713378 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713685 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.713987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.714081 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.714290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.714390 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.714593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.714688 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.714901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715039 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715335 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.715968 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.716144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.716238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.716446 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.716574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.716772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.716889 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717186 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717488 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.717983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.718076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.718324 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.718432 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.718628 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.718872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.718975 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.719193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.719344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.719556 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.719653 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.719888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.719983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.720206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.720305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.720529 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.720633 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.720846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.720940 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.721163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.721314 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.721986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.722139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.722313 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.722407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.722629 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.722734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.722942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.723041 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.723274 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.723382 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.723584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.723747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.723900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.724002 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.724209 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.724337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.724522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.724657 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.724843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.725034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.725362 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.725454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.725674 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.725768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.725986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.726080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.726297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.726389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.726608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.726709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.726921 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727027 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727237 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727334 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727865 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.727959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.728174 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.728282 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.728499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.728599 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.728816 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.728924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.729129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.729236 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.729440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.729542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.729757 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.729850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.730981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.731076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.731338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.731438 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.731644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.731750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.731954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732049 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732701 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.732994 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.733194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.733286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.733501 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.733603 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.733807 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.733906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.734115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.734208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.734422 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.734573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.734727 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.734819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735128 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735685 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.735998 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.736100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.736359 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.736464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.736745 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.736875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.737817 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.737917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738132 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738450 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738786 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.738889 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.739114 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.739255 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.739461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.739562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.739783 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.739884 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.740101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.740194 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.740428 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.740646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.740747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.740992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.741086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.741323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.741460 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.741633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.741740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.741936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742029 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742253 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742868 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.742962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.743185 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.743312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.743514 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.743617 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.743838 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.744039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.744154 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.744383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.744485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.744698 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.744795 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745449 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.745966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746066 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746276 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746685 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746882 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.746977 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.747196 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.747370 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.747528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.747628 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.747825 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.747919 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.748129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.748224 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.748435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.748536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.748743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.748837 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749154 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749354 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749448 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.749985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.750080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.750290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.750389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.750593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.750687 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.750937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.751046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.751203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.751317 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.751526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.751631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.751828 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.752976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.753077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.753292 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.753387 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.753608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.753708 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.753916 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754010 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754331 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754524 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754849 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.754951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.755179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.755311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.755509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.755612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.755814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.755897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.756129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.756225 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.756438 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.756542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.756758 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.756854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.757067 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.757193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.757377 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.757471 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.757700 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.757794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758112 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758334 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758877 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.758985 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.759196 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.759337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.759551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.759652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.759857 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.759964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.760169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.760263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.760471 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.760563 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.760775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.760878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761081 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761388 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761480 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761795 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.761999 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.762098 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.762305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.762405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.762609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.762702 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.762915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763257 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763373 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763549 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763853 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.763947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.764158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.764259 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.764462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.764562 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.764768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.764862 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.765074 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.765181 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.765386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.765486 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.765722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.765830 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766141 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766667 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766800 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.766983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.767079 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.767313 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.767463 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.767640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.767770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.767930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.768032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.768238 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.768380 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.768601 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.768733 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.768907 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769219 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769314 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769527 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769622 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.769941 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.770174 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.770276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.770502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.770609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.770813 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.770907 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.771133 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.771256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.771478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.771582 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.771798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.771907 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.772107 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.772207 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.772421 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.772528 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.772728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.772866 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.773053 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.773212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.773370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.773473 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.773691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.773792 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774103 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774611 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774713 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.774913 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775649 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775862 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.775966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.776164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.776257 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.776466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.776559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.776773 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.776915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777515 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777839 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.777979 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.778164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.778285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.778487 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.778589 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.778799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.778894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.779048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 15:23:52.779142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.779472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.779775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.780076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.780382 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.780686 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.780988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.781289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.781591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.781890 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.782220 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.782551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.782863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.783185 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.783773 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.784629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.784936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.785371 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.785696 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.786014 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.786320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.786652 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.786960 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.787292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.787605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.787916 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.788222 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.788531 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.788863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.789190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.789497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.789827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.790150 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.790472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.790788 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.791101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.791456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.791770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.792079 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.792393 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.792702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.793011 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.793328 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.793642 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.793971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.794298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.794607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.794930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.795278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.795635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.795948 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.796296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.796624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.796938 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.797247 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.797554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:23:52.797798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 15:23:52.932598 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO dbcounter [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Registered counter for database nova_api Jul 06 15:23:52.949375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Registered counter for database nova_api Jul 06 15:23:52.952289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:52.959461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writer thread running {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:52.968821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:52.976248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.016199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.context [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),817b0a4d-22b1-494d-b98d-37da4df0b98a(cell1) {{(pid=117620) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 15:23:53.020618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:23:53.022203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:23:53.023020 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:23:53.025025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:23:53.027006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO dbcounter [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Registered counter for database nova_cell0 Jul 06 15:23:53.031541 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO dbcounter [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Registered counter for database nova_cell1 Jul 06 15:23:53.031657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.context [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),817b0a4d-22b1-494d-b98d-37da4df0b98a(cell1) {{(pid=117619) load_cells /opt/stack/nova/nova/context.py:464}} Jul 06 15:23:53.036486 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:23:53.038120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:23:53.038965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:23:53.039423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:53.040963 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:23:53.043282 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Registered counter for database nova_cell0 Jul 06 15:23:53.044543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writer thread running {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.045188 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:53.047413 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Registered counter for database nova_cell1 Jul 06 15:23:53.054676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:53.056454 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:53.062468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.063753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.187047 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writer thread running {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.195896 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO dbcounter [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Registered counter for database nova_cell0 Jul 06 15:23:53.202764 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_db.sqlalchemy.engines [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:53.208046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Registered counter for database nova_cell0 Jul 06 15:23:53.208384 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writer thread running {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.217106 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:23:53.222699 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:23:53.535301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: WARNING keystonemiddleware.auth_token [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:23:53.542720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: WARNING keystonemiddleware.auth_token [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:23:53.558606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:23:53.566383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:23:53.886891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: WARNING keystonemiddleware.auth_token [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:23:53.892975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: WARNING keystonemiddleware.auth_token [None req-f0c89e42-56f8-49e4-90aa-d7543be05323 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:23:53.898298 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de482c89c0 pid: 117620 (default app) Jul 06 15:23:53.906418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 06 15:23:53.912649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-e45ddf79-c2ed-45ca-a005-3a595273c95d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 06 15:23:53.918553 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de482c89c0 pid: 117619 (default app) Jul 06 15:24:32.792945 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:32.794357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:32.795528 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:32.797051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:33.924263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d18f5ce8-092b-4a8e-bda5-fc25e679e6ec tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Action: 'create', calling method: .version_select at 0x7f449ec85550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-454856986", "metadata": {"Type": "work"}}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d18f5ce8-092b-4a8e-bda5-fc25e679e6ec tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Request method failure captured: Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 121 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixakwAceEh6FxEtAqWyE04kO7DWvGdMFUMawBYRxCtBF_jrtnvD9cib7G8BRAJ04E6PVz9P8codbxCQ8wt8Fv9gSqNsDjqvxdXzz9XvOzmI4EQiC-XYSDNSzKpdNJdtw1E14KaVTVFh0kRwLsOq1fnOJwTCdm8uBTlup7TK6chwhwp80 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:24:33.948492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f95961717a844969240b7b718c8e764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f95961717a844969240b7b718c8e764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 30c6a87965c349a3aeebeddf65a4c0fa Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-454856986", "metadata": {"Type": "work"}}} Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: Jul 06 15:24:33.950134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-454856986', 'metadata': {'Type': 'work'}}}} Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise error Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi '#$%' Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:33.951126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 06 15:24:33.952626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 06 15:24:33.959870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 06 15:24:33.959870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:33.959870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d18f5ce8-092b-4a8e-bda5-fc25e679e6ec tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:33.959870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d18f5ce8-092b-4a8e-bda5-fc25e679e6ec tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.175484 Jul 06 15:24:33.959870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jul 6 15:24:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:24:33.968364 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:33.969932 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:33.970588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:33.972363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:34.176414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e3e323ff-dc9b-43e2-9fd1-ce3a82d1472f tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Action: 'create', calling method: .version_select at 0x7f449eccd0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1551903580", "metadata": {"Type": "work"}}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e3e323ff-dc9b-43e2-9fd1-ce3a82d1472f tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Request method failure captured: Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 120 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixakwAceEh6FxEtAqWyE04kO7DWvGdMFUMawBYRxCtBF_jrtnvD9cib7G8BRAJ04E6PVz9P8codbxCQ8wt8Fv9gSqNsDjqvxdXzz9XvOzmI4EQiC-XYSDNSzKpdNJdtw1E14KaVTVFh0kRwLsOq1fnOJwTCdm8uBTlup7TK6chwhwp80 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:24:34.180323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f95961717a844969240b7b718c8e764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f95961717a844969240b7b718c8e764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 30c6a87965c349a3aeebeddf65a4c0fa Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1551903580", "metadata": {"Type": "work"}}} Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: Jul 06 15:24:34.181645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1551903580', 'metadata': {'Type': 'work'}}}} Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise error Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi '0' Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:34.183415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 06 15:24:34.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 06 15:24:34.185887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 06 15:24:34.185887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.185887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e3e323ff-dc9b-43e2-9fd1-ce3a82d1472f tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:34.185887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e3e323ff-dc9b-43e2-9fd1-ce3a82d1472f tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.218973 Jul 06 15:24:34.185887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jul 6 15:24:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:24:34.192112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7549791-b1c3-4d91-8734-76fe106a497e tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Action: 'create', calling method: .version_select at 0x7f449ec0e940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-882039256", "metadata": {"Type": "work"}}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7549791-b1c3-4d91-8734-76fe106a497e tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Request method failure captured: Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 118 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixakwAceEh6FxEtAqWyE04kO7DWvGdMFUMawBYRxCtBF_jrtnvD9cib7G8BRAJ04E6PVz9P8codbxCQ8wt8Fv9gSqNsDjqvxdXzz9XvOzmI4EQiC-XYSDNSzKpdNJdtw1E14KaVTVFh0kRwLsOq1fnOJwTCdm8uBTlup7TK6chwhwp80 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:24:34.194712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f95961717a844969240b7b718c8e764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f95961717a844969240b7b718c8e764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 30c6a87965c349a3aeebeddf65a4c0fa Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-882039256", "metadata": {"Type": "work"}}} Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: Jul 06 15:24:34.196218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-882039256', 'metadata': {'Type': 'work'}}}} Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise error Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi '' Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:34.197151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 06 15:24:34.198689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 06 15:24:34.200013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 06 15:24:34.200013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:34.200013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7549791-b1c3-4d91-8734-76fe106a497e tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:34.200013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a7549791-b1c3-4d91-8734-76fe106a497e tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008515 Jul 06 15:24:34.201808 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jul 6 15:24:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:24:34.207787 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-95a0ecdf-e414-45b3-b2c5-b23e77b26fc3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Calling method '.version_select at 0x7f449ebd7280>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:35.246631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-34928789-08f9-4b0e-840c-4c1f6728e30b tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Action: 'create', calling method: .version_select at 0x7f449ec859d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1383417366"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:35.861915 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-95a0ecdf-e414-45b3-b2c5-b23e77b26fc3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] HTTP exception thrown: Volume tempest-invalid-401895776 could not be found. Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-95a0ecdf-e414-45b3-b2c5-b23e77b26fc3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Request method failure captured: Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-401895776 HTTP/1.1 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixakwAceEh6FxEtAqWyE04kO7DWvGdMFUMawBYRxCtBF_jrtnvD9cib7G8BRAJ04E6PVz9P8codbxCQ8wt8Fv9gSqNsDjqvxdXzz9XvOzmI4EQiC-XYSDNSzKpdNJdtw1E14KaVTVFh0kRwLsOq1fnOJwTCdm8uBTlup7TK6chwhwp80 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:24:35.869625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f95961717a844969240b7b718c8e764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f95961717a844969240b7b718c8e764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 30c6a87965c349a3aeebeddf65a4c0fa Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Volume tempest-invalid-401895776 could not be found. Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'tempest-invalid-401895776'} Jul 06 15:24:35.871069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-401895776 could not be found. (HTTP 404) (Request-ID: req-5c831098-f2d3-4364-81c4-51cf65e70317) Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:35.872583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 15:24:35.875295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-401895776 could not be found. Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:35.879482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-401895776 could not be found. Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-401895776 could not be found. Jul 06 15:24:35.883195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:35.885335 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-95a0ecdf-e414-45b3-b2c5-b23e77b26fc3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Returning 404 to user: Volume tempest-invalid-401895776 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:35.886606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-95a0ecdf-e414-45b3-b2c5-b23e77b26fc3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-401895776" status: 404 len: 98 microversion: 2.1 time: 1.684225 Jul 06 15:24:35.888685 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1214 bytes} [Wed Jul 6 15:24:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-401895776 => generated 98 bytes in 1687 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 06 15:24:35.906835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7dd43cd6-60ba-44b6-b01b-e3a4cdb50110 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011037 Jul 06 15:24:35.908909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1139 bytes} [Wed Jul 6 15:24:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 06 15:24:35.925951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-77716cf5-1685-4468-9375-33367de15ddd tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008166 Jul 06 15:24:35.927520 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 4/6] 10.222.0.46 () {58 vars in 1136 bytes} [Wed Jul 6 15:24:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 06 15:24:35.940111 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-958db719-2472-4f0f-a965-4124be7d51a3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Calling method '.version_select at 0x7f449ead93a0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:36.587656 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-958db719-2472-4f0f-a965-4124be7d51a3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] HTTP exception thrown: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-958db719-2472-4f0f-a965-4124be7d51a3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Request method failure captured: Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/os-volumes/9e6870e7-e082-42c2-bbd9-bae0c0bd139e HTTP/1.1 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixakwAceEh6FxEtAqWyE04kO7DWvGdMFUMawBYRxCtBF_jrtnvD9cib7G8BRAJ04E6PVz9P8codbxCQ8wt8Fv9gSqNsDjqvxdXzz9XvOzmI4EQiC-XYSDNSzKpdNJdtw1E14KaVTVFh0kRwLsOq1fnOJwTCdm8uBTlup7TK6chwhwp80 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:24:36.589641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f95961717a844969240b7b718c8e764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f95961717a844969240b7b718c8e764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 30c6a87965c349a3aeebeddf65a4c0fa Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '9e6870e7-e082-42c2-bbd9-bae0c0bd139e'} Jul 06 15:24:36.591641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. (HTTP 404) (Request-ID: req-2e41f654-292f-40ea-aef4-c9d7afc77033) Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:36.592624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 15:24:36.593983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 06 15:24:36.595097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-958db719-2472-4f0f-a965-4124be7d51a3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Returning 404 to user: Volume 9e6870e7-e082-42c2-bbd9-bae0c0bd139e could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:36.597117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-958db719-2472-4f0f-a965-4124be7d51a3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/9e6870e7-e082-42c2-bbd9-bae0c0bd139e" status: 404 len: 109 microversion: 2.1 time: 0.654728 Jul 06 15:24:36.606935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 5/7] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:24:35 2022] DELETE /compute/v2.1/os-volumes/9e6870e7-e082-42c2-bbd9-bae0c0bd139e => generated 109 bytes in 675 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:24:36.613235 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cad11313-4a1f-42f3-8470-c1a5f5be66f3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Calling method '.version_select at 0x7f449eb54790>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:36.956167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-cad11313-4a1f-42f3-8470-c1a5f5be66f3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] HTTP exception thrown: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cad11313-4a1f-42f3-8470-c1a5f5be66f3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Request method failure captured: Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/os-volumes/7a4f8583-e526-45c2-bc4c-9000db1072e9 HTTP/1.1 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixakwAceEh6FxEtAqWyE04kO7DWvGdMFUMawBYRxCtBF_jrtnvD9cib7G8BRAJ04E6PVz9P8codbxCQ8wt8Fv9gSqNsDjqvxdXzz9XvOzmI4EQiC-XYSDNSzKpdNJdtw1E14KaVTVFh0kRwLsOq1fnOJwTCdm8uBTlup7TK6chwhwp80 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:24:36.958097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f95961717a844969240b7b718c8e764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f95961717a844969240b7b718c8e764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f95961717a844969240b7b718c8e764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 8f95961717a844969240b7b718c8e764 Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1982080865 Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 30c6a87965c349a3aeebeddf65a4c0fa Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1982080865-project Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '7a4f8583-e526-45c2-bc4c-9000db1072e9'} Jul 06 15:24:36.959588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. (HTTP 404) (Request-ID: req-12928929-393a-47e9-a222-7638cd41e70d) Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:36.960550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:36.961855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 15:24:36.963023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cad11313-4a1f-42f3-8470-c1a5f5be66f3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] Returning 404 to user: Volume 7a4f8583-e526-45c2-bc4c-9000db1072e9 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cad11313-4a1f-42f3-8470-c1a5f5be66f3 tempest-VolumesNegativeTest-1982080865 tempest-VolumesNegativeTest-1982080865-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7a4f8583-e526-45c2-bc4c-9000db1072e9" status: 404 len: 109 microversion: 2.1 time: 0.350074 Jul 06 15:24:36.964342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 6/8] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:24:36 2022] GET /compute/v2.1/os-volumes/7a4f8583-e526-45c2-bc4c-9000db1072e9 => generated 109 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:24:37.083453 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-34928789-08f9-4b0e-840c-4c1f6728e30b tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.206641 Jul 06 15:24:37.084091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 3/9] 10.222.0.46 () {60 vars in 1154 bytes} [Wed Jul 6 15:24:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2209 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 06 15:24:37.105710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-082b0194-1cad-423e-99c8-f5c635a033b6 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eccde50>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:37.700770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-082b0194-1cad-423e-99c8-f5c635a033b6 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 200 len: 345 microversion: 2.1 time: 0.607919 Jul 06 15:24:37.702056 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 7/10] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:24:37 2022] GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 345 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:24:38.715519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b5f5127b-804f-4ae6-a19d-15585d1a183d tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb05f70>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:38.885351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b5f5127b-804f-4ae6-a19d-15585d1a183d tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 200 len: 346 microversion: 2.1 time: 0.173956 Jul 06 15:24:38.892350 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 4/11] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:24:38 2022] GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:38.898005 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7e102eb0-3f02-4f71-b321-8bf6cc529b20 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Action: 'create', calling method: .version_select at 0x7f449ead90d0>, body: {"snapshot": {"volume_id": "c7bebff6-522f-4e89-84cb-54fce7101027", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1207736784"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:39.655630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7e102eb0-3f02-4f71-b321-8bf6cc529b20 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.761285 Jul 06 15:24:39.656543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 8/12] 10.222.0.46 () {60 vars in 1161 bytes} [Wed Jul 6 15:24:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:39.668203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f91b639f-2094-4d78-9fa0-12922da56ca5 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb13670>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:39.806958 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f91b639f-2094-4d78-9fa0-12922da56ca5 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.143298 Jul 06 15:24:39.808064 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 5/13] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:39 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:39.817350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1f9810cc-b1f3-474d-9111-8faea583f463 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449ead9280>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:39.981731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1f9810cc-b1f3-474d-9111-8faea583f463 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.168056 Jul 06 15:24:39.982813 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 9/14] 10.222.0.46 () {58 vars in 1139 bytes} [Wed Jul 6 15:24:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:39.993501 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-72066827-d033-4878-be60-257ccc997055 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb13a60>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:40.121910 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-72066827-d033-4878-be60-257ccc997055 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.132349 Jul 06 15:24:40.126019 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 6/15] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:39 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:41.134039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c89e86db-0ad3-4c8a-a202-02b6d41022c5 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eae1a60>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:41.223880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c89e86db-0ad3-4c8a-a202-02b6d41022c5 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.093812 Jul 06 15:24:41.224724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 10/16] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:41 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:42.236639 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b71e7807-d37e-42a0-af0b-e61d3731ed27 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb13310>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:42.293129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b71e7807-d37e-42a0-af0b-e61d3731ed27 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.060879 Jul 06 15:24:42.294463 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 7/17] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:42 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:43.305949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-16e77db5-eb63-457c-b311-77da07bb6316 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449ead9040>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:43.410739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-16e77db5-eb63-457c-b311-77da07bb6316 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 288 microversion: 2.1 time: 0.109126 Jul 06 15:24:43.411702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 11/18] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:43 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 288 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:43.423552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9022fda3-801d-4a0b-bd2a-a5842f1a6d26 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb13e50>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:43.582057 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9022fda3-801d-4a0b-bd2a-a5842f1a6d26 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 202 len: 0 microversion: 2.1 time: 0.163344 Jul 06 15:24:43.582759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 8/19] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Jul 6 15:24:43 2022] DELETE /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:24:43.591490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c8298fc1-e76e-4a7c-9b9e-30451daae625 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb2ec10>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:43.648174 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c8298fc1-e76e-4a7c-9b9e-30451daae625 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.060815 Jul 06 15:24:43.649104 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 12/20] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:43 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:44.661966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3e1da983-9590-4d66-a312-c8b62666191d tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb13b80>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:44.743256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3e1da983-9590-4d66-a312-c8b62666191d tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.087220 Jul 06 15:24:44.744238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 9/21] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:44 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:45.755564 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-481115ef-96a1-4672-84a6-b15f769d0af2 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb2ef70>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:45.837497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-481115ef-96a1-4672-84a6-b15f769d0af2 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 200 len: 287 microversion: 2.1 time: 0.086640 Jul 06 15:24:45.838079 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 13/22] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:45 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:46.336712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ce945aa0-b3fe-4839-8566-9c129631f8f8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: .version_select at 0x7f449eb13430>, body: {"keypair": {"name": "tempest-keypair-1277962341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuyRTqLacZ7DTtHVa7Q24rNDQEnL6uuLWcGKOVQYLsH0CQR76JnjTkl/muddveGTxhEmeeGS//W3JB3DohCsaO+qbyGgaPD0I5oKxV5WOKKJpB/mpeGBUC77e9uY/upCQ=="}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:46.440980 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-ce945aa0-b3fe-4839-8566-9c129631f8f8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for project 6707399c704e4c97939dc84df58cb39f. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:24:46.453429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-ce945aa0-b3fe-4839-8566-9c129631f8f8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for user 0f5497ff570f4affbbd1b2f9129c24ac and project 6707399c704e4c97939dc84df58cb39f. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:24:46.535146 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ce945aa0-b3fe-4839-8566-9c129631f8f8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.444080 Jul 06 15:24:46.539074 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 10/23] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:24:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:46.849304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-670221d0-dff7-48f8-a06a-69c2b3609633 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eae1700>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:46.913270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-670221d0-dff7-48f8-a06a-69c2b3609633 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] HTTP exception thrown: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-670221d0-dff7-48f8-a06a-69c2b3609633 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Request method failure captured: Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 HTTP/1.1 Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixakyRKGGHj6zyYYT-M0oCiITit-upOeLJy-5l4aO4CT6WvKxQ5OkSeoU6r0uA-KrBllK0LaIgNPssKVxhbJpeGn4tjzLikiFMZDQ6IJFxbU6IUK7kLuMBW5rMm53j-SxlEXwYvwEH1dqe1X8t0-QCT2uvnWWqFoQRLL8HC5-LeHuaWU Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:24:46.916148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27ad835846e74888a8792c08fdebf965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27ad835846e74888a8792c08fdebf965"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 24403707b8f54765b1189f511689379e Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '12b5e137-5d31-42be-a7cd-9283a0dd7d58'} Jul 06 15:24:46.917418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. (HTTP 404) (Request-ID: req-29b6b3b4-f4b7-43f3-9146-4f3e5dec4d2c) Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.918243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:46.919462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 06 15:24:46.920654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-670221d0-dff7-48f8-a06a-69c2b3609633 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Returning 404 to user: Snapshot 12b5e137-5d31-42be-a7cd-9283a0dd7d58 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:46.921910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-670221d0-dff7-48f8-a06a-69c2b3609633 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58" status: 404 len: 111 microversion: 2.1 time: 0.075383 Jul 06 15:24:46.923235 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 14/24] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jul 6 15:24:46 2022] GET /compute/v2.1/os-snapshots/12b5e137-5d31-42be-a7cd-9283a0dd7d58 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:24:46.931009 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-226494c9-3806-458e-9182-753c6c649532 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eae0820>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:47.089821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-226494c9-3806-458e-9182-753c6c649532 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 202 len: 0 microversion: 2.1 time: 0.162821 Jul 06 15:24:47.091744 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 11/25] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:24:46 2022] DELETE /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:24:47.102591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38546aeb-9bd9-416f-969c-e579cadbe1d4 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449eb2eb80>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:47.194678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-38546aeb-9bd9-416f-969c-e579cadbe1d4 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 200 len: 345 microversion: 2.1 time: 0.098246 Jul 06 15:24:47.196192 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 15/26] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:24:47 2022] GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:24:48.211012 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f0b5bb0d-7ab9-417a-aae9-f02e55eced97 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449ea9c550>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:48.276771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-f0b5bb0d-7ab9-417a-aae9-f02e55eced97 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] HTTP exception thrown: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f0b5bb0d-7ab9-417a-aae9-f02e55eced97 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Request method failure captured: Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 HTTP/1.1 Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixakyRKGGHj6zyYYT-M0oCiITit-upOeLJy-5l4aO4CT6WvKxQ5OkSeoU6r0uA-KrBllK0LaIgNPssKVxhbJpeGn4tjzLikiFMZDQ6IJFxbU6IUK7kLuMBW5rMm53j-SxlEXwYvwEH1dqe1X8t0-QCT2uvnWWqFoQRLL8HC5-LeHuaWU Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:24:48.282114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27ad835846e74888a8792c08fdebf965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27ad835846e74888a8792c08fdebf965"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 24403707b8f54765b1189f511689379e Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'c7bebff6-522f-4e89-84cb-54fce7101027'} Jul 06 15:24:48.283941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. (HTTP 404) (Request-ID: req-9476f926-3d30-41a0-b48e-eea5fff04fe0) Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.284647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:48.285547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 15:24:48.287362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f0b5bb0d-7ab9-417a-aae9-f02e55eced97 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Returning 404 to user: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:48.289485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f0b5bb0d-7ab9-417a-aae9-f02e55eced97 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 404 len: 109 microversion: 2.1 time: 0.080958 Jul 06 15:24:48.301296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cef0069f-b5af-4a26-bd5b-b834f405fe52 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449ead9550>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:48.312520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 12/27] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:24:48 2022] GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:24:48.374964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-cef0069f-b5af-4a26-bd5b-b834f405fe52 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] HTTP exception thrown: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cef0069f-b5af-4a26-bd5b-b834f405fe52 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Request method failure captured: Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 HTTP/1.1 Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixakyRKGGHj6zyYYT-M0oCiITit-upOeLJy-5l4aO4CT6WvKxQ5OkSeoU6r0uA-KrBllK0LaIgNPssKVxhbJpeGn4tjzLikiFMZDQ6IJFxbU6IUK7kLuMBW5rMm53j-SxlEXwYvwEH1dqe1X8t0-QCT2uvnWWqFoQRLL8HC5-LeHuaWU Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:24:48.379996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27ad835846e74888a8792c08fdebf965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27ad835846e74888a8792c08fdebf965"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 24403707b8f54765b1189f511689379e Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'c7bebff6-522f-4e89-84cb-54fce7101027'} Jul 06 15:24:48.381339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. (HTTP 404) (Request-ID: req-c2eb73da-da54-46cb-818f-767f1345d69c) Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.382182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 06 15:24:48.383513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 06 15:24:48.384957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.386254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.388798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cef0069f-b5af-4a26-bd5b-b834f405fe52 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Returning 404 to user: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:48.390052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cef0069f-b5af-4a26-bd5b-b834f405fe52 tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 404 len: 109 microversion: 2.1 time: 0.093907 Jul 06 15:24:48.391100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 16/28] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:24:48 2022] DELETE /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:24:48.400902 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7817596-fcdf-4aff-986c-497c55da9e3f tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Calling method '.version_select at 0x7f449e26f1f0>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:48.483686 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-a7817596-fcdf-4aff-986c-497c55da9e3f tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] HTTP exception thrown: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7817596-fcdf-4aff-986c-497c55da9e3f tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Request method failure captured: Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 HTTP/1.1 Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixakyRKGGHj6zyYYT-M0oCiITit-upOeLJy-5l4aO4CT6WvKxQ5OkSeoU6r0uA-KrBllK0LaIgNPssKVxhbJpeGn4tjzLikiFMZDQ6IJFxbU6IUK7kLuMBW5rMm53j-SxlEXwYvwEH1dqe1X8t0-QCT2uvnWWqFoQRLL8HC5-LeHuaWU Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:24:48.486303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27ad835846e74888a8792c08fdebf965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27ad835846e74888a8792c08fdebf965"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27ad835846e74888a8792c08fdebf965"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 27ad835846e74888a8792c08fdebf965 Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1864798276 Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 24403707b8f54765b1189f511689379e Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1864798276-project Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'c7bebff6-522f-4e89-84cb-54fce7101027'} Jul 06 15:24:48.488223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. (HTTP 404) (Request-ID: req-d962cdcb-54a6-4beb-9cb4-55c848a9b95f) Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.488995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:24:48.489975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 15:24:48.491068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7817596-fcdf-4aff-986c-497c55da9e3f tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] Returning 404 to user: Volume c7bebff6-522f-4e89-84cb-54fce7101027 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a7817596-fcdf-4aff-986c-497c55da9e3f tempest-VolumesSnapshotsTestJSON-1864798276 tempest-VolumesSnapshotsTestJSON-1864798276-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027" status: 404 len: 109 microversion: 2.1 time: 0.092700 Jul 06 15:24:48.491986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 13/29] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:24:48 2022] GET /compute/v2.1/os-volumes/c7bebff6-522f-4e89-84cb-54fce7101027 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:24:50.045140 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1401785301", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:50.281248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] validate_networks() for [('2f7f712f-7346-42c2-b097-b4b48d9f78be', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:24:52.487169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:24:52.488622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:24:52.489854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:24:52.490507 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:24:52.491051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:24:52.527884 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:24:52.534011 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:24:52.538726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:24:52.539188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:24:52.644669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for project ef44ecc951964d51925463c5e09f9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:24:52.662556 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for user 46896be59b73481287235aac3d630f4e and project ef44ecc951964d51925463c5e09f9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:24:52.714145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:24:52.730006 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:24:52.941588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3485f93c-9c16-4c66-81c9-c96cb9b2fdd3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.213733 Jul 06 15:24:52.942560 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 17/30] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:24:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:24:52.953662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4db563dc-6fed-4f62-8653-d91bf202cf39 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:24:52.955066 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4db563dc-6fed-4f62-8653-d91bf202cf39 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:24:53.586249 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4db563dc-6fed-4f62-8653-d91bf202cf39 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:24:53.619432 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4db563dc-6fed-4f62-8653-d91bf202cf39 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1222 microversion: 2.1 time: 0.670686 Jul 06 15:24:53.621863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 14/31] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:24:52 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1222 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:24:53.998228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1552169222", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:54.147062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] validate_networks() for [('2f7f712f-7346-42c2-b097-b4b48d9f78be', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:24:54.684738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d83ce2e1-fa40-4d25-b143-563af4623feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: .version_select at 0x7f449ea9cdc0>, body: {"keypair": {"name": "tempest-keypair-1449558180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOltxGlWFvEpi4L+ZpnM3SapjBYsHJ9IBLVPosWKtiM2wqIlV65red2zEYapBdQkllnY/7qc5sYprQ2erwN0jkOMQ2YjxnM9P3rQCUGGPnTHWssKhLO7Zmjh155oAfUzrQ=="}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:54.725057 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-d83ce2e1-fa40-4d25-b143-563af4623feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:24:54.740205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-d83ce2e1-fa40-4d25-b143-563af4623feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:24:54.853779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d83ce2e1-fa40-4d25-b143-563af4623feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.520077 Jul 06 15:24:54.854400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 15/32] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:24:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:24:55.046104 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-840614765", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "networks": [{"uuid": "e25275fc-af73-47fb-bfc4-a4005b8727d8"}]}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:55.293830 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] validate_networks() for [('e25275fc-af73-47fb-bfc4-a4005b8727d8', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:24:56.524417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:24:56.525546 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:24:56.526207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:24:56.526753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:24:56.527326 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:24:56.543639 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:24:56.546058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:24:56.547912 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:24:56.548518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:24:56.596573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for project ef44ecc951964d51925463c5e09f9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:24:56.607465 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for user 46896be59b73481287235aac3d630f4e and project ef44ecc951964d51925463c5e09f9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:24:56.631616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:24:56.633726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:24:56.698708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9dc10968-6420-4039-bf95-e0b55ffa1955 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.706315 Jul 06 15:24:56.706474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 18/33] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:24:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:24:56.713392 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1280950744", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3020644-2bbb-40b0-b72d-4d80a8b6cb34"}], "security_groups": [{"name": "tempest-securitygroup--885031446"}], "key_name": "tempest-keypair-1277962341", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:24:57.183980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] validate_networks() for [('c3020644-2bbb-40b0-b72d-4d80a8b6cb34', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:25:00.272250 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:25:00.272825 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:25:00.273391 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:25:00.273866 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:25:00.274213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:25:00.294495 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:25:00.295031 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:25:00.295409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:25:00.296000 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:25:00.296558 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:25:00.305573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:00.317317 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:00.317317 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:00.317317 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:00.327542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:00.328000 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:00.328794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:00.350384 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:00.438834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for project 6707399c704e4c97939dc84df58cb39f. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:25:00.456907 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Getting quotas for project 9be64cd89e3b46738dca85e516a60d8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:25:00.465771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for user 0f5497ff570f4affbbd1b2f9129c24ac and project 6707399c704e4c97939dc84df58cb39f. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:25:00.478076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Getting quotas for user 213ac803c2cb4cbfb4d73ec4fb07d552 and project 9be64cd89e3b46738dca85e516a60d8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:25:00.531398 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:25:00.540705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:25:00.543500 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:25:00.552198 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:25:00.728265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9532d39a-e3d0-4188-a50f-bd16a61d5505 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.020264 Jul 06 15:25:00.739030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 19/34] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:24:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 4032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:25:00.768214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:00.768898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:00.838593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:00.839150 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:00.840238 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:00.840676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:00.860987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4af53e81-ba92-44d1-b645-221efaae62c3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.005497 Jul 06 15:25:00.861927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 16/35] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 6007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:25:00.878348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a7a9ee57-1897-4832-acbf-e156c55dd162 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:00.880760 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a7a9ee57-1897-4832-acbf-e156c55dd162 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:01.254521 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a7a9ee57-1897-4832-acbf-e156c55dd162 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:01.270579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a7a9ee57-1897-4832-acbf-e156c55dd162 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1238 microversion: 2.1 time: 0.406869 Jul 06 15:25:01.282689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 17/36] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:00 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1238 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:01.307969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8da74b89-29f6-4dff-9b94-6853f4983c3d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:01.308693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8da74b89-29f6-4dff-9b94-6853f4983c3d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:01.676392 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8da74b89-29f6-4dff-9b94-6853f4983c3d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:01.696076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8da74b89-29f6-4dff-9b94-6853f4983c3d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1214 microversion: 2.1 time: 0.408849 Jul 06 15:25:01.697110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 18/37] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:01 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1214 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:01.759179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:01.810380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5a510977-cd69-4b97-ad25-8929183ed138 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1280 microversion: 2.1 time: 1.065408 Jul 06 15:25:01.813005 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 20/38] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:00 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1280 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:02.304127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:02.305486 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:02.324159 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:02.325825 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:02.328093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:02.328693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:02.715889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:02.716547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:02.774316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:02.786770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:02.787759 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:02.799695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:02.834663 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:02.861429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d2490e42-2847-480a-b4d8-6eb15649599f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1234 microversion: 2.1 time: 0.565825 Jul 06 15:25:02.872691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 19/39] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:02 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1234 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:02.888467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:02.894879 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:02.918099 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:02.930936 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:02.933821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:02.937748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:03.157573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:03.168561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df1cad05-0209-470e-9bf5-fe6da33a38f8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1210 microversion: 2.1 time: 0.459206 Jul 06 15:25:03.169844 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 21/40] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:02 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1210 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:03.190981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-341806310", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5"}], "security_groups": [{"name": "tempest-securitygroup--1468776008"}], "key_name": "tempest-keypair-1449558180", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:03.440882 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] validate_networks() for [('a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:25:03.665626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:03.677594 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5ac1c991-3670-4158-bff7-3c091e95a2d4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.799247 Jul 06 15:25:03.679374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 20/41] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:02 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:03.886174 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:03.887260 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:03.896293 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:03.897749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:03.898693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:03.899454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:04.023108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:04.034561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4e5f1cb0-a02c-41d6-bf09-698a141edf48 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1290 microversion: 2.1 time: 0.157963 Jul 06 15:25:04.045443 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:03 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1290 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:04.187366 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:04.188246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:04.197462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:04.198483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:04.201708 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:04.203105 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:04.343070 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:04.354416 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3824a332-a053-4d3c-8316-d5be6a4172a6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.172238 Jul 06 15:25:04.354999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:04 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:04.697901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:04.698431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:04.714743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:04.716845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:04.719364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:04.721181 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.174200 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:05.186603 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bd37129e-fbc6-4e3a-bb43-2d140ce0f8fa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.493001 Jul 06 15:25:05.187580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 23/44] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:04 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:05.323531 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-3c943af9-e6ff-4907-b2ab-e1fcca96d478 req-fb5c360b-b8ba-4caf-9602-d53ecd63629f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce440c64-f3db-4cda-8a2f-0f7e00f36b30", "tag": "ee13c450-a247-45da-9000-1d74f1a8c8aa"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:05.338797 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-3c943af9-e6ff-4907-b2ab-e1fcca96d478 req-fb5c360b-b8ba-4caf-9602-d53ecd63629f service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.339604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-3c943af9-e6ff-4907-b2ab-e1fcca96d478 req-fb5c360b-b8ba-4caf-9602-d53ecd63629f service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.368155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-3c943af9-e6ff-4907-b2ab-e1fcca96d478 req-fb5c360b-b8ba-4caf-9602-d53ecd63629f service nova] Creating event network-changed:ee13c450-a247-45da-9000-1d74f1a8c8aa for instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 on hv-cinder-84884 Jul 06 15:25:05.369930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-3c943af9-e6ff-4907-b2ab-e1fcca96d478 req-fb5c360b-b8ba-4caf-9602-d53ecd63629f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117620) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 06 15:25:05.372408 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.372957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.373812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.374451 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.387722 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.compute.rpcapi [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 06 15:25:05.388957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] Releasing lock "compute-rpcapi-router" {{(pid=117620) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 06 15:25:05.413504 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c6370b2c-6674-416d-865b-f368bff1de84 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224468 Jul 06 15:25:05.414185 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 24/45] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:05.422040 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:05.423054 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:05.443372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.444068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.445894 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.447087 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.527207 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:05.536232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-af1b00b3-0399-4693-a8fe-a5b418a01679 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1290 microversion: 2.1 time: 0.120528 Jul 06 15:25:05.536981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 25/46] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:05 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:05.541684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:05.542548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:05.551305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.552695 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.553712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.554332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.751729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:05.762574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-16f14123-cf25-45a1-baa6-89d1c7f7e8a7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.224307 Jul 06 15:25:05.776652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 26/47] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:05 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:05.890144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:25:05.891300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:25:05.895349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:25:05.895349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:25:05.895349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:25:05.915823 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.916423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.918302 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:05.919424 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:05.975385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:25:05.997123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:25:06.056712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:25:06.062089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:25:06.205621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:06.206251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:06.219434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:06.219917 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:06.231835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b1712d58-1f5d-4c20-a42c-10e70a598c48 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.055066 Jul 06 15:25:06.236053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 22/48] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:25:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:25:06.257853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:06.261225 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f39f54e1-f5e8-4a14-bb4a-7f9f4fb5a9cf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:06.262323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f39f54e1-f5e8-4a14-bb4a-7f9f4fb5a9cf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:06.263890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:06.499980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f39f54e1-f5e8-4a14-bb4a-7f9f4fb5a9cf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:06.537789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f39f54e1-f5e8-4a14-bb4a-7f9f4fb5a9cf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1241 microversion: 2.1 time: 0.294269 Jul 06 15:25:06.555747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 23/49] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:06 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1241 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:06.568234 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:06.571477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:06.589208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:06.591657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:06.592639 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:06.593528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:06.709482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:06.725173 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3cb37e2c-5c94-4a09-841e-94a9004c6576 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1290 microversion: 2.1 time: 0.168121 Jul 06 15:25:06.726216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 24/50] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:06 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:06.737902 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:06.746416 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6aa24e77-ad53-4670-b955-0fd877a98505 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.545495 Jul 06 15:25:06.750455 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 27/51] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:06 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:06.782002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:06.784191 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:06.792970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:06.793820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:06.794810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:06.795572 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:06.916329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:06.925232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7ec52e42-0549-44f8-89e2-dccca5d664d7 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.147345 Jul 06 15:25:06.925932 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 25/52] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:06 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:07.572094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:07.573385 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:07.581361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.581748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.582562 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.583007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.681639 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:07.692510 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-de8462d7-5826-4280-80d0-b60d7ad20151 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.124269 Jul 06 15:25:07.702841 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 28/53] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:07 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:07.743531 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:07.744347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:07.750934 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.751584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.753413 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.755132 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.772337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:07.773502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:07.780182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.780926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.787554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.788391 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.853937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:07.863711 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b58b20b4-314d-42e1-9524-a596d5695422 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1290 microversion: 2.1 time: 0.123881 Jul 06 15:25:07.864352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 26/54] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:07 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:07.941891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:07.949519 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:07.953058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:07.965373 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-de9f26f7-1708-477d-8280-b43044012099 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.201611 Jul 06 15:25:07.965961 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 29/55] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:07 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:07.972080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.973171 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:07.975709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:07.976376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:08.072181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:08.081137 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d99912cb-51a1-4801-a7b8-07e3440fadbb tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.143073 Jul 06 15:25:08.082229 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 27/56] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:07 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:08.710423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:08.712598 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:08.727373 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:08.730504 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:08.731541 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:08.732324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:08.824891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:08.849962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-057c6562-445f-4c17-8a32-4447e1b9f565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.142333 Jul 06 15:25:08.850969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 30/57] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:08 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:08.880741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:08.881745 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:08.893869 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:08.894482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:08.895953 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:08.896620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:08.981916 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:08.982538 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:08.990157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:08.998445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c7c36502-fab3-4e1f-829b-a251dd0f77f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1298 microversion: 2.1 time: 0.121686 Jul 06 15:25:09.010407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:09.010788 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 28/58] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:08 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:09.011476 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:09.012484 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:09.013095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:09.099183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:09.100881 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:09.129510 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:09.129981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:09.130995 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:09.133638 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:09.261505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:09.270133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7d1b9845-38dc-49dd-9046-b6ab8d162e1e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.291971 Jul 06 15:25:09.275856 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:09.279604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 31/59] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:08 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:09.287703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6dc1d1d4-a1ce-4f8d-9451-165c9bd075b1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.193164 Jul 06 15:25:09.288970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 29/60] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:09 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:09.868005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:09.868663 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:09.874670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:09.875118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:09.883264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:09.883717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:09.959927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:09.975771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0c30c48f-e377-42de-8bc4-ca0291174f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.111475 Jul 06 15:25:09.976847 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 32/61] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:09 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:10.015112 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:10.015937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:10.024209 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:10.025187 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:10.026295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:10.027703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:10.106315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:10.117063 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1cf9218b-c93e-4d0a-b984-8103328c83ea tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1298 microversion: 2.1 time: 0.105651 Jul 06 15:25:10.117758 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 30/62] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:10 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:10.286001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:10.286618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:10.293560 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:10.294226 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:10.301849 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:10.302500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:10.307063 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:10.308126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:10.322316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:10.323247 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:10.327082 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:10.327787 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:10.404947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:10.413337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d65d2ad7-55b4-446a-92e8-1b9f353f79c5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.111672 Jul 06 15:25:10.429166 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 31/63] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:10 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:10.497932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:10.510637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-204d3273-ee8b-4518-be3c-001fe79c3a8d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.228608 Jul 06 15:25:10.512862 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 33/64] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:10 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:10.995831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:10.996473 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:11.014232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.014814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.015647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.016219 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.119949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:11.128090 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5f418ca1-5eb2-4879-b951-bf9d1b04e32a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.137272 Jul 06 15:25:11.128676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 32/65] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:10 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:11.141074 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:11.141897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:11.152420 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.153136 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.153986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.154489 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.247285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:11.256972 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fcc27b52-4b51-4421-9b2a-44890ff2bb6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1298 microversion: 2.1 time: 0.126305 Jul 06 15:25:11.258008 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 34/66] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:11 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:11.433002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:11.433936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:11.442521 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.442958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.443911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.444346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.512118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:11.522368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a35bf58a-75ec-46d9-90a1-b5f16e22aa2c tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.094434 Jul 06 15:25:11.522368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 33/67] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:11 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:11.527789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:11.528413 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:11.535293 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.535773 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.536546 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:11.536979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:11.555530 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:11.680932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=20 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:11.691773 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:11.712998 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-af9c50a5-424f-4e8e-bc7e-91e8260dc341 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.189165 Jul 06 15:25:11.716394 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 35/68] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:11 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:12.146490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:12.148101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:12.159604 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.160313 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.161433 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.166070 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.263506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:12.273532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:12.274213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:12.277278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-aafc551d-d3de-453c-a27e-a8fd328d1ee3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.135910 Jul 06 15:25:12.279534 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:12 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:12.296629 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.298612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.300610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.301691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.465736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:12.477609 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0123922d-7fad-48c8-a337-76a1b6ba87de tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1298 microversion: 2.1 time: 0.207835 Jul 06 15:25:12.479374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 36/70] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:12 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1298 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:12.545158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:12.546630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:12.561444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:12.568130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.568908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.571657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.572406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.735062 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:12.737112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:12.750947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:12.752367 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.763207 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:12.763403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9e5bab95-5356-4fce-b206-173c69826cf2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.227542 Jul 06 15:25:12.764177 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 35/71] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:12 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:12.767899 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:12.767899 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.103278 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:13.113570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2cb413d2-b608-43e9-bc0a-4cbda5cf03c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.383855 Jul 06 15:25:13.114802 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 37/72] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:12 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:13.296489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:13.297942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:13.312746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:13.313479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.316244 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:13.317771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.446703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:13.457357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c8010e75-8823-431d-9117-654ca16b69b2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.167230 Jul 06 15:25:13.465600 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 36/73] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:13 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:13.497962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:13.498635 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:13.501441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:13.518025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:13.518482 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.521153 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:13.522264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.611826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:13.620429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-22b3c6b1-a223-4d82-8b70-396bf4a1abf7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1298 microversion: 2.1 time: 0.128602 Jul 06 15:25:13.621950 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 38/74] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:13 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:13.798290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:13.799137 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:13.806709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:13.807538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.820308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:13.822152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:13.828948 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:13.938024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:13.960143 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4f8d4623-8ac5-4fa8-8f7f-03b7a0d7da3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.176702 Jul 06 15:25:13.963024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 37/75] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:13 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:14.132093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:14.133513 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:14.140237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.140690 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:14.141452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.141879 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:14.487951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:14.488686 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:14.509297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.510161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:14.512285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.515004 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:14.815530 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:14.828090 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4d350050-d26e-4db2-9526-661d4b1a2feb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1245 microversion: 2.1 time: 0.347067 Jul 06 15:25:14.839017 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 38/76] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:14 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1245 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:14.844746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:14.845949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:14.866782 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.867342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:14.868904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.869550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:14.901579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:14.910085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e57c6864-ff90-4831-acbe-b184dbb9617b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.783393 Jul 06 15:25:14.918732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 39/77] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:14 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:14.966205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:14.982439 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:14.983058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:14.983196 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9feefe5e-2335-4cf0-9399-4015297f4c0c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1296 microversion: 2.1 time: 0.142984 Jul 06 15:25:14.983820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 39/78] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:14 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1296 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:14.999363 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:14.999820 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:15.000599 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:15.001032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:15.101444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:15.112123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1748f3e7-ebba-460c-ad95-aa7916babbcf tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1266 microversion: 2.1 time: 0.133796 Jul 06 15:25:15.113162 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 40/79] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:14 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:15.849646 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:15.851078 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:15.860987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:15.863830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:15.876183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:15.879550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:15.927016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:15.935034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:15.948840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=4 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:15.954484 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:15.955952 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:15.959253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:15.963208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=8 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:15.963681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:16.136750 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:16.149661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-619a2e5a-20cc-4097-a7e3-5b6c2c321156 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1311 microversion: 2.1 time: 0.304026 Jul 06 15:25:16.152620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 40/80] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:15 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1311 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:16.180270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:16.181282 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:16.198058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:16.198416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:16.200355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:16.201053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:16.489218 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:16.499984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-03748b47-2872-4e26-800d-d1281749f066 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1296 microversion: 2.1 time: 0.331391 Jul 06 15:25:16.500857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 41/81] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:16 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1296 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:16.506536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:16.507498 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:16.520632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:16.520632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:16.521848 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:16.522591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:16.529748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=26 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:16.622998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:16.632535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f7f7cd09-d328-4dbc-9cfc-4f34aa354d73 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1272 microversion: 2.1 time: 0.130038 Jul 06 15:25:16.635193 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 42/82] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:16 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:16.872822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:16.897733 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2d107b45-2732-447d-b680-26a7b1fe0307 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.975000 Jul 06 15:25:16.899446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 41/83] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:15 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:16.920261 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-a2a702c9-4403-4b59-8083-32444adbfbd0 req-ea23031d-e5ee-4d5f-9ae0-244c56a920ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00187af-8819-41e6-98f0-199ce9db0f05", "tag": "e5ce60d9-c5f8-4326-aa01-dd12e4cd2dd6"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:16.950582 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a2a702c9-4403-4b59-8083-32444adbfbd0 req-ea23031d-e5ee-4d5f-9ae0-244c56a920ba service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:16.953991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a2a702c9-4403-4b59-8083-32444adbfbd0 req-ea23031d-e5ee-4d5f-9ae0-244c56a920ba service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.015305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-a2a702c9-4403-4b59-8083-32444adbfbd0 req-ea23031d-e5ee-4d5f-9ae0-244c56a920ba service nova] Creating event network-changed:e5ce60d9-c5f8-4326-aa01-dd12e4cd2dd6 for instance e00187af-8819-41e6-98f0-199ce9db0f05 on hv-cinder-84884 Jul 06 15:25:17.034618 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a2a702c9-4403-4b59-8083-32444adbfbd0 req-ea23031d-e5ee-4d5f-9ae0-244c56a920ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=117619) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 06 15:25:17.040429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.040981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.041841 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.042274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.064803 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.compute.rpcapi [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 06 15:25:17.067020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] Releasing lock "compute-rpcapi-router" {{(pid=117619) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 06 15:25:17.125076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-68f17b73-c0b4-4a71-9735-2684ad9c3a9e None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208111 Jul 06 15:25:17.126625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 43/84] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:17.170098 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:17.170751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:17.179168 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.179902 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.181059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.181728 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.519054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:17.519985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:17.525954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:17.541202 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-95037f2f-8fa9-44b8-9219-949c12bd18d7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1299 microversion: 2.1 time: 0.368897 Jul 06 15:25:17.541836 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 42/85] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:17 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1299 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:17.546830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.548090 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.549014 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.549573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.628860 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:17.640422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6a8b38b7-6d2c-483a-9203-b61ad5f6262c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1296 microversion: 2.1 time: 0.126389 Jul 06 15:25:17.642155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 44/86] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:17 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:17.655023 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:17.655930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:17.663065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.663823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.664796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.665424 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.804195 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:17.813205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8cb5c8fb-857d-4dd4-8f56-cddb4ac921ec tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1272 microversion: 2.1 time: 0.162020 Jul 06 15:25:17.815082 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 43/87] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:17 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:17.917312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:17.917816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:17.925436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.926072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:17.926626 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:17.927053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.294260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:18.304558 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5081ab2d-72f4-4ada-b2fa-961af02be079 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.391627 Jul 06 15:25:18.324617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 45/88] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:17 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:18.575834 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:18.578927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:18.594999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:18.599381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.604726 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:18.605572 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.664848 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:18.665650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:18.687019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:18.687397 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.688183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:18.688618 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.846851 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:18.857977 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-53c35423-6729-42c7-a511-93abb4b3357d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1299 microversion: 2.1 time: 0.301005 Jul 06 15:25:18.858775 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 44/89] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:18 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1299 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:18.870308 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:18.870941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:18.885863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:18.887361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:18.887823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.889777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:18.890217 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:18.895922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1fa72924-1cd0-4bb1-b503-94896055a413 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.241951 Jul 06 15:25:18.906420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 46/90] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:18 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:19.331009 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:19.331726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:19.338045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:19.338749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:19.339711 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:19.340298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:19.510850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:19.520546 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9739df5a-c5ac-40e1-bffe-55907a8d988a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.192724 Jul 06 15:25:19.530355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 47/91] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:19 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:19.791576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:19.798896 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ea48d700-9fa5-45e8-a549-ccdce249242d tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.938425 Jul 06 15:25:19.811569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 45/92] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:18 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:19.875576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:19.876738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:19.884292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:19.884742 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:19.885644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:19.886085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:19.914192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:19.914863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:19.923075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:19.923661 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:19.924465 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:19.924956 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:20.041266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:20.049991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ec74e7b0-6aa5-4ea2-a615-2d2d3850f10c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.178490 Jul 06 15:25:20.050632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 48/93] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:19 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:20.354757 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:20.365151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-cf42fc1e-3e40-459a-a1b0-346bd9c63c45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.455372 Jul 06 15:25:20.365742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 46/94] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:19 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:20.537770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:20.539041 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:20.545952 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:20.546840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:20.548302 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:20.548898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:20.710584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:20.718928 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a043eec8-c0d1-460a-90e1-462aac5f6717 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.185120 Jul 06 15:25:20.720586 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 49/95] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:20 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:20.815030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:20.815680 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:20.821672 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:20.822117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:20.822885 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:20.823341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:20.938896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-581065e5-bb33-466f-871d-ed336a9d1336 req-34ff2d9c-5d71-4001-8739-17173f86b24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3811251a-a0ba-4f29-9160-96c0f3f46c52", "tag": "fe67390d-68cb-4317-96a3-d85d3d7d6ff7"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:20.948617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-581065e5-bb33-466f-871d-ed336a9d1336 req-34ff2d9c-5d71-4001-8739-17173f86b24d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:20.949057 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-581065e5-bb33-466f-871d-ed336a9d1336 req-34ff2d9c-5d71-4001-8739-17173f86b24d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:20.963076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-581065e5-bb33-466f-871d-ed336a9d1336 req-34ff2d9c-5d71-4001-8739-17173f86b24d service nova] Creating event network-changed:fe67390d-68cb-4317-96a3-d85d3d7d6ff7 for instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 on hv-cinder-84884 Jul 06 15:25:20.969511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-581065e5-bb33-466f-871d-ed336a9d1336 req-34ff2d9c-5d71-4001-8739-17173f86b24d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034206 Jul 06 15:25:20.970726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 50/96] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:21.067802 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:21.068776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:21.081504 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:21.089444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ac0f192b-9f24-446e-ac19-bbab29010a08 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.278200 Jul 06 15:25:21.090572 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 47/97] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:20 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:21.090824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:21.091630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:21.092630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:21.093287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:21.236859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:21.246547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c14b9972-9a0c-40fc-b909-752374da9a4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.184185 Jul 06 15:25:21.247172 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 51/98] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:21 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:21.382066 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:21.382684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:21.389167 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:21.389620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:21.390404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:21.390840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:21.525633 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:21.533891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6681c072-aeef-44b2-b94f-d8d2bf70947e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.155715 Jul 06 15:25:21.534461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 48/99] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:21 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:21.736293 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:21.736898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:21.742780 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:21.743280 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:21.744030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:21.744458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:21.870856 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:21.878693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-69479b95-6c59-463a-a9e3-a1620b76e61f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.146585 Jul 06 15:25:21.879279 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 52/100] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:21 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:22.106191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:22.106799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:22.113523 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.113965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.114703 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.115129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.241840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:22.249527 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6e26527c-bba1-402f-9f38-ce0338070682 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.147114 Jul 06 15:25:22.250095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 49/101] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:22 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:22.262979 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:22.263553 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:22.270054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.270497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.271273 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.271706 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.398684 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:22.406025 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cad4fa25-3842-445a-a5f7-87cf92d2133b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.146881 Jul 06 15:25:22.406592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 53/102] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:22 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:22.556719 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:22.561049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:22.569725 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.570552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.571511 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.572233 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.795952 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:22.804892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-af99d53e-7542-4849-8525-c30231d84073 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.258359 Jul 06 15:25:22.814208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 50/103] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:22 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:22.894665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:22.896183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:22.902555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.903119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:22.904110 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:22.904656 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.006127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-9b568434-62a1-4c98-a6f8-e3819b404150 req-a86687f4-3fc8-4396-9d33-90e20c2dd131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60af238-6eb5-450e-adf6-2e01797e448c", "tag": "ed64b6d5-5c31-4bdf-85ee-153655020dd2"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:23.024803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-9b568434-62a1-4c98-a6f8-e3819b404150 req-a86687f4-3fc8-4396-9d33-90e20c2dd131 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.030783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-9b568434-62a1-4c98-a6f8-e3819b404150 req-a86687f4-3fc8-4396-9d33-90e20c2dd131 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.084769 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-9b568434-62a1-4c98-a6f8-e3819b404150 req-a86687f4-3fc8-4396-9d33-90e20c2dd131 service nova] Creating event network-changed:ed64b6d5-5c31-4bdf-85ee-153655020dd2 for instance a60af238-6eb5-450e-adf6-2e01797e448c on hv-cinder-84884 Jul 06 15:25:23.093973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-9b568434-62a1-4c98-a6f8-e3819b404150 req-a86687f4-3fc8-4396-9d33-90e20c2dd131 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097862 Jul 06 15:25:23.097222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 51/104] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:23.122477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:23.126312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:23.131640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b059780f-4746-44ef-a9e2-7565e86aeea0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.240552 Jul 06 15:25:23.132730 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 54/105] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:22 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:23.267967 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:23.268681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:23.275351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.275741 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.276506 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.276943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.412873 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:23.416402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:23.421718 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5bad5889-fef2-4dab-a41e-17ed199d1f21 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.159502 Jul 06 15:25:23.422285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 52/106] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:23 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:23.424008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:23.424636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:23.430606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.431046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.431823 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.432248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.559978 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:23.567266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ee54087-f33c-48d5-a19f-58d758866f4b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.147489 Jul 06 15:25:23.567825 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 55/107] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:23 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:23.821991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:23.822632 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:23.828688 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.829620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.830388 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:23.830826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:23.959889 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:23.967255 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-60ef0b4a-1850-45f6-9a24-e7106baa868a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.149088 Jul 06 15:25:23.967822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 53/108] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:23 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:24.148118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:24.148717 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:24.154635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.155073 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.155851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.156277 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.282950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:24.291400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f282bf05-60de-48c8-9309-5c193d05d735 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.146950 Jul 06 15:25:24.292000 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 56/109] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:24 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:24.438438 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:24.439534 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:24.445553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.446005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.446759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.447192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.573244 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:24.580660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-cfb2ec2a-8da2-4253-9b77-cd5b7605bd3a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.146384 Jul 06 15:25:24.581238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 54/110] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:24 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:24.583747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:24.584387 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:24.590327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.590769 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.591545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.591975 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.717675 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:24.725076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a7b428d1-a6f6-4a5e-8409-79843c4b15e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.145198 Jul 06 15:25:24.725649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 57/111] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:24 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:24.984406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:24.984951 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:24.991494 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.991943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:24.992698 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:24.993133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.116487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-6f85ce73-c9d5-4649-ae8b-6dea28590404 req-e00e39f6-08a2-401b-aca2-744254e7fd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a347082e-a86f-46f0-a018-e3918e3e8262", "tag": "1517f5a9-ced9-4ab6-a63d-d158af2a6089"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:25.125046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6f85ce73-c9d5-4649-ae8b-6dea28590404 req-e00e39f6-08a2-401b-aca2-744254e7fd00 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.125566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6f85ce73-c9d5-4649-ae8b-6dea28590404 req-e00e39f6-08a2-401b-aca2-744254e7fd00 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.126327 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:25.134643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-188a52a9-80e5-4aba-af7f-6ff9628c420a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.154019 Jul 06 15:25:25.135401 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 55/112] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:24 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:25.145909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-6f85ce73-c9d5-4649-ae8b-6dea28590404 req-e00e39f6-08a2-401b-aca2-744254e7fd00 service nova] Creating event network-changed:1517f5a9-ced9-4ab6-a63d-d158af2a6089 for instance a347082e-a86f-46f0-a018-e3918e3e8262 on hv-cinder-84884 Jul 06 15:25:25.151157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-6f85ce73-c9d5-4649-ae8b-6dea28590404 req-e00e39f6-08a2-401b-aca2-744254e7fd00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038380 Jul 06 15:25:25.152327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 58/113] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:25:25.307834 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:25.308441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:25.314370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.314819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.315615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.316046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.443932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:25.451239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d4e4f3be-80cd-40c2-b265-8092d1935795 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.147259 Jul 06 15:25:25.451787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 56/114] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:25 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:25.598475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:25.599203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:25.605598 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.606044 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.606796 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.607243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.735588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:25.741539 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:25.742147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:25.743021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-815b5500-ea44-4cf6-b07e-1edb55a2e4dd tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.149390 Jul 06 15:25:25.743627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 59/115] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:25 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:25.748292 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.748744 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.749512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:25.749947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:25.877548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:25.884881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ed4fbc05-7ad4-41c9-bf1a-8c6bd9e277af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.147174 Jul 06 15:25:25.885444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 57/116] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:25 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:26.151354 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:26.151964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:26.158356 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.158807 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.159686 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.160034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.321116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:26.329476 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1cf7096b-1d01-49a0-8de3-6fdf9eca40fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.181920 Jul 06 15:25:26.330054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 60/117] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:26 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:26.472510 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:26.473299 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:26.479947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.480784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.481748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.482694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.628913 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:26.636214 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a9414d06-7531-4cec-a7aa-bfe0826dfba4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.171129 Jul 06 15:25:26.636771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 58/118] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:26 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:26.760021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:26.760623 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:26.766571 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.767542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.768285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.768710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.895950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:26.901840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:26.902450 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:26.903497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e4dd64db-904a-4495-9253-8551e6f620a0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.147252 Jul 06 15:25:26.904073 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 61/119] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:26 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:26.908686 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.909131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:26.909889 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:26.910320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.036619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:27.043974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3ae2cbfc-fdb9-4b02-be18-27ef7a226ffc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.145909 Jul 06 15:25:27.044537 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 59/120] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:26 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:27.347056 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:27.347627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:27.349581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:27.355709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:27.356268 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.357180 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:27.357621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.482984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:27.490960 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-55269e06-f09c-4f91-b25c-07a866dd4e05 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.148486 Jul 06 15:25:27.491570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 62/121] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:27 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:27.652578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:27.653127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:27.659983 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:27.660430 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.661205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:27.661621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.920511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:27.921040 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:27.929862 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:27.930362 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.931370 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:27.931810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:27.964458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:27.971814 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-733ad20c-3c32-4f90-80f6-d4160726bd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.323078 Jul 06 15:25:27.972388 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 60/122] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:27 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:28.061950 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:28.062556 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:28.068862 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:28.069124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:28.069775 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:28.070540 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:28.070973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:28.076273 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d1c91232-0ee3-4c9f-b3c1-7bd96e7b4165 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.159738 Jul 06 15:25:28.076842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 63/123] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:27 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:28.196174 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:28.203300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-382848c2-0622-4897-b43f-80464b8ee7fd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.145381 Jul 06 15:25:28.203861 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 61/124] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:28 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:28.507429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:28.508176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:28.514211 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:28.514662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:28.515453 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:28.515909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:28.690757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:28.699805 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3d9ea346-7f9f-4d3c-875f-b5d7af0e7a4c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.196303 Jul 06 15:25:28.701174 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 64/125] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:28 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:28.988904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:28.989549 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:28.996738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:28.997188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:28.997952 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:28.998384 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.016128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-70cb3480-2301-4595-bfa7-98d4f33a46e4 req-7470e0b5-7c97-4562-9130-a08c8396d28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce440c64-f3db-4cda-8a2f-0f7e00f36b30", "name": "network-vif-plugged", "status": "completed", "tag": "ee13c450-a247-45da-9000-1d74f1a8c8aa"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:29.025799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-70cb3480-2301-4595-bfa7-98d4f33a46e4 req-7470e0b5-7c97-4562-9130-a08c8396d28d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.026296 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-70cb3480-2301-4595-bfa7-98d4f33a46e4 req-7470e0b5-7c97-4562-9130-a08c8396d28d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.039196 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-70cb3480-2301-4595-bfa7-98d4f33a46e4 req-7470e0b5-7c97-4562-9130-a08c8396d28d service nova] Creating event network-vif-plugged:ee13c450-a247-45da-9000-1d74f1a8c8aa for instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 on hv-cinder-84884 Jul 06 15:25:29.044388 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-70cb3480-2301-4595-bfa7-98d4f33a46e4 req-7470e0b5-7c97-4562-9130-a08c8396d28d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089392 Jul 06 15:25:29.045369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 62/126] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:25:29.095745 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:29.096799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:29.105146 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.105920 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.106881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.107559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.150247 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:29.160104 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-15f02285-b351-4e45-b04c-8736f746c8bf tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.175433 Jul 06 15:25:29.172188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 65/127] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:28 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:29.224597 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:29.224597 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:29.230471 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.231151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.232035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.232734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.638462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:29.650536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8d5c1df5-98fe-4eac-a4ad-a0a0e25038f9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.432511 Jul 06 15:25:29.651283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 66/128] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:29 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:29.719851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:29.721214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:29.734612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.735069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.738237 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:29.738947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:29.997338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:30.007482 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3ae01d39-eaa4-4433-9830-2195063e20a1 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.917378 Jul 06 15:25:30.008521 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 63/129] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:29 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:30.018247 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:30.027158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1e559f68-1cb5-48ba-8f50-a986684880ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.313180 Jul 06 15:25:30.027835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 67/130] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:29 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:30.181043 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:30.182962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:30.205415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:30.206096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:30.207396 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:30.209975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:30.584000 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:30.619275 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-301ffd19-e7fb-433c-ae40-aec4907890d3 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.445295 Jul 06 15:25:30.627034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 64/131] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:30 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:30.670692 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:30.671452 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:30.680786 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:30.681233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:30.681990 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:30.682414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:30.948208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:30.960241 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a6891c46-c448-450c-a066-ef8f5f55c093 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.293528 Jul 06 15:25:30.968526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 68/132] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:30 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:31.025992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:31.026626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:31.033474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:31.033917 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:31.034740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:31.035172 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:31.044474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:31.045194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:31.053923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:31.054989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:31.055616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:31.056135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:31.213048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:31.242642 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c7c801fd-98ff-4197-a81d-79d345ea01c4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.219748 Jul 06 15:25:31.244581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 65/133] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:31 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:31.249330 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:31.259645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-866750cf-0ba4-469d-938a-81e5ec0f4b14 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.219316 Jul 06 15:25:31.260458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 69/134] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:31 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:31.645444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:31.645444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:31.654931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:31.654931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:31.654931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:31.654931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:31.818249 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:31.827093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0d746ecb-e673-4785-abd6-bc2b9d4ca95d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.187106 Jul 06 15:25:31.827506 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 66/135] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:31 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:31.981020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:31.983408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:31.995779 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.002107 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.005772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.006523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.228171 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:32.237760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c2d96579-ca96-41de-8803-67b74fb5d269 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.264094 Jul 06 15:25:32.241941 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 70/136] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:31 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:32.264700 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:32.265380 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:32.277229 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.277684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.277939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:32.278633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:32.279409 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.281185 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.289479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.293152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.295808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.296414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.499279 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:32.507379 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ab1672c7-c294-404f-a046-24d04b65edb2 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.234251 Jul 06 15:25:32.511363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 71/137] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:32 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:32.841163 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:32.843797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:32.845186 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:32.853320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-858f324a-255e-44c1-843d-6bcd5c4f777e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.596619 Jul 06 15:25:32.854046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 67/138] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:32 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:32.856509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.856970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.857789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:32.858161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:32.869332 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:33.002432 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-6fb54479-d36b-4ee9-b2ae-5ee1e03d98da req-a06a0f1c-7a99-4244-a1ba-b559f7b412d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00187af-8819-41e6-98f0-199ce9db0f05", "name": "network-vif-plugged", "status": "completed", "tag": "e5ce60d9-c5f8-4326-aa01-dd12e4cd2dd6"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:33.018309 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-6fb54479-d36b-4ee9-b2ae-5ee1e03d98da req-a06a0f1c-7a99-4244-a1ba-b559f7b412d7 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.020754 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-6fb54479-d36b-4ee9-b2ae-5ee1e03d98da req-a06a0f1c-7a99-4244-a1ba-b559f7b412d7 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:33.037136 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:33.045911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df52699e-b790-4914-a4be-4eeb5506b28b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.205822 Jul 06 15:25:33.060437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 72/139] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:32 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:33.069189 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-6fb54479-d36b-4ee9-b2ae-5ee1e03d98da req-a06a0f1c-7a99-4244-a1ba-b559f7b412d7 service nova] Creating event network-vif-plugged:e5ce60d9-c5f8-4326-aa01-dd12e4cd2dd6 for instance e00187af-8819-41e6-98f0-199ce9db0f05 on hv-cinder-84884 Jul 06 15:25:33.075606 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-6fb54479-d36b-4ee9-b2ae-5ee1e03d98da req-a06a0f1c-7a99-4244-a1ba-b559f7b412d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079436 Jul 06 15:25:33.076947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 68/140] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:33.265526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:33.268237 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:33.277138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.277859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:33.278979 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.279631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:33.466441 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:33.477542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-67e3023a-dcc4-4760-89a7-55ef8597d2d1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.223162 Jul 06 15:25:33.478586 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 73/141] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:33 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:33.526766 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:33.528358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:33.537078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.538170 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:33.539662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.540232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:33.695940 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:33.704786 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f08ac498-6d11-4659-a1cd-1693586b8e50 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.183209 Jul 06 15:25:33.705456 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 69/142] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:33 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:33.871629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:33.872988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:33.880066 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.880734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:33.881816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:33.882629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.021916 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:34.029711 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d1b4b531-7fde-4098-b04b-a64db374e7e9 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.163172 Jul 06 15:25:34.030288 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 74/143] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:33 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:34.066417 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:34.067024 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:34.073763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:34.074871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.076154 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:34.076758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.230330 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:34.233871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:34.238783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2ae064df-72db-48fd-a643-ed5e1375abe8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.176159 Jul 06 15:25:34.247984 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 70/144] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:34 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:34.493700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:34.494301 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:34.500604 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:34.501561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.502318 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:34.503970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.647901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:34.656958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3faec53f-8c10-4cce-8daf-07256a7f9a78 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.166735 Jul 06 15:25:34.658761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 75/145] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:34 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:34.721842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:34.723133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:34.730155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:34.730477 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.731298 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:34.731694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:34.880315 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:34.888798 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6a81cc29-4f07-45b4-949c-e2d601f1ddb6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.170920 Jul 06 15:25:34.889599 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 71/146] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:34 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:35.047524 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:35.048912 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:35.056307 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.056779 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.057640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.058201 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.230572 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:35.241083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-685c2694-0d40-4948-9ca8-33c7dfe4f7e0 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.197592 Jul 06 15:25:35.242194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 76/147] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:35 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:35.258406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:35.259208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:35.267648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.268094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.268855 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.269453 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.427291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:35.436078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dd0ed093-894a-4cf0-8108-e36ff2d48b46 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.184564 Jul 06 15:25:35.436676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 72/148] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:35 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:35.674612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:35.675300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:35.682168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.682698 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.683515 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.683970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.908188 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:35.908930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:35.917219 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.918527 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.923503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:35.924223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:35.929680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:35.938051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-625878f0-9eb4-48d8-a701-62799fe062e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.268330 Jul 06 15:25:35.942053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 77/149] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:35 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:36.117812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:36.125705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b3645bf0-af2b-468d-a997-660bcddc7c92 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.222836 Jul 06 15:25:36.126490 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 73/150] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:35 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:36.259727 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:36.260611 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:36.268718 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:36.269393 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:36.270321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:36.270903 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:36.455769 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:36.457129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:36.465245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:36.466162 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:36.467142 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:36.467953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:36.482348 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:36.492902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-67040e2b-7694-4fb5-abbe-35df25bf686e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.238355 Jul 06 15:25:36.493822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 78/151] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:36 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:36.945193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:36.955539 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4822f0d8-9cd3-4987-8d11-4ca1616cd46a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.505598 Jul 06 15:25:36.956447 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 74/152] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:36 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:36.956568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:36.957280 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:36.964629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:36.964629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:36.970862 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:36.971361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.142514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:37.143120 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:37.171882 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.173612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.177607 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.178220 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.185434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:37.194734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b18988c0-264a-4655-b0f2-5ba278ce8e11 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.243036 Jul 06 15:25:37.195696 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 79/153] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:36 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:37.410717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:37.425152 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-387f4289-1d0a-4098-bdc7-32341537c208 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.286355 Jul 06 15:25:37.427814 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 75/154] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:37 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:37.511384 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:37.512219 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:37.525087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.525539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.526306 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.526954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.665076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-816283ae-45a7-467b-8b4e-a8d5a45874f4 req-05d32cb2-5353-45f1-8bfc-49d8b7146728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60af238-6eb5-450e-adf6-2e01797e448c", "name": "network-vif-plugged", "status": "completed", "tag": "ed64b6d5-5c31-4bdf-85ee-153655020dd2"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:37.684328 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-816283ae-45a7-467b-8b4e-a8d5a45874f4 req-05d32cb2-5353-45f1-8bfc-49d8b7146728 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.685249 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-816283ae-45a7-467b-8b4e-a8d5a45874f4 req-05d32cb2-5353-45f1-8bfc-49d8b7146728 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.706105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:37.714237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-816283ae-45a7-467b-8b4e-a8d5a45874f4 req-05d32cb2-5353-45f1-8bfc-49d8b7146728 service nova] Creating event network-vif-plugged:ed64b6d5-5c31-4bdf-85ee-153655020dd2 for instance a60af238-6eb5-450e-adf6-2e01797e448c on hv-cinder-84884 Jul 06 15:25:37.717327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ed0aced0-9f91-4f11-ae41-d70b17d4074f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.210741 Jul 06 15:25:37.729690 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 80/155] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:37 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:37.729966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-816283ae-45a7-467b-8b4e-a8d5a45874f4 req-05d32cb2-5353-45f1-8bfc-49d8b7146728 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069198 Jul 06 15:25:37.730578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 76/156] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:37.973933 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:37.975379 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:37.982297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.982872 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:37.983721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:37.984202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.168674 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:38.181555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f6aa7e1e-f998-490a-8899-4a7e4d71be82 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1322 microversion: 2.1 time: 0.212960 Jul 06 15:25:38.186502 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 81/157] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:37 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:38.213855 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:38.214566 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:38.225779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:38.227002 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.229305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:38.229753 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.446207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:38.447363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:38.460447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:38.460895 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.461714 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:38.462133 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.516481 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:38.530838 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9c82f899-e5a8-4e8e-8dd9-eb4443fbc73c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.320870 Jul 06 15:25:38.541338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 77/158] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:38 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:38.657847 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:38.667986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4297a500-06a8-4d59-8bd8-7859f3187634 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.226573 Jul 06 15:25:38.669071 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 82/159] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:38 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:38.739128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:38.739828 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:38.751985 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:38.755587 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.756829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:38.757514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:38.976051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:38.983682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3f18fdaa-cc07-4158-b598-5fc8668464a5 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.251878 Jul 06 15:25:38.984246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 78/160] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:38 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:39.202805 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:39.203451 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:39.210176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.210623 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.211416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.211838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.347942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:39.355319 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e3718270-1dfc-421f-b63f-720a0cc29c73 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1517 microversion: 2.1 time: 0.156154 Jul 06 15:25:39.367682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 83/161] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:39 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:39.374104 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:39.375445 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:39.381767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.383677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.383677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.383677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.452124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'flavor' on Instance uuid e00187af-8819-41e6-98f0-199ce9db0f05 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:25:39.550754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:39.551403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:39.566654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.567097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.574906 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.579759 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.626720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1e011c1d-1d29-47dc-b7d8-ae75a1be93ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05/action" status: 200 len: 32 microversion: 2.1 time: 0.257438 Jul 06 15:25:39.627354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 79/162] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:25:39 2022] POST /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 06 15:25:39.643300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:39.645293 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:39.663599 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.666279 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.668680 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.670573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.929356 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:39.938810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-83ecc128-2961-47b5-a923-6e084c6d345a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.393505 Jul 06 15:25:39.953784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 84/163] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:39 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:39.962682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:39.963538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:39.970317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:39.972551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.973197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.974641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:39.975314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:39.982319 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:40.009704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d60b946f-71d4-43bb-a839-5e8d8d7fc8ca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.376834 Jul 06 15:25:40.010323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 80/164] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:39 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:40.015568 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:40.016116 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:40.035261 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:40.035947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:40.037346 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:40.038040 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:40.200108 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:40.211448 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-91c5b17f-0b60-4af9-9f32-fffb3b39571e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.255484 Jul 06 15:25:40.215297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 85/165] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:39 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:40.260992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:40.269536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-95b83c66-4f26-4e1b-a659-5fd530eca9f3 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1314 microversion: 2.1 time: 0.258196 Jul 06 15:25:40.270674 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 81/166] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:40 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:40.960341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:40.961188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:40.969072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:40.969965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:40.970958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:40.971640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.028512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:41.029876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:41.046874 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:41.048350 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.060638 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:41.061130 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.218116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:41.231933 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4730501a-262f-4c4c-a883-413cb5624a2b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.274360 Jul 06 15:25:41.232853 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 86/167] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:40 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:41.238307 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:41.238632 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:41.239042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:41.246284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:41.247052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.248134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:41.249088 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.267080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bda25faa-269e-4538-9617-d971a7ed805f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.244611 Jul 06 15:25:41.267705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 82/168] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:41 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:41.287774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:41.288570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:41.295277 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:41.296002 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.296888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:41.298075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:41.398339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:41.407688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-495683a9-4c49-4c52-b486-4a8c61ccc3d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.172745 Jul 06 15:25:41.410087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 87/169] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:41 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:41.464349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:41.473673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-89fd309c-ca0c-487a-8e0e-a2ee10c32cc8 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1500 microversion: 2.1 time: 0.190099 Jul 06 15:25:41.474246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 83/170] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:41 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:42.250424 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:42.251157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:42.259800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.260270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.261045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.261475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.287933 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:42.289142 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:42.306314 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.306768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.309645 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.310096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.537847 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:42.546278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:42.549432 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f50e8997-5576-4d8a-b9b6-0aeba3b931ed tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.303632 Jul 06 15:25:42.554252 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 88/171] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:42 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:42.562677 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:42.567388 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:42.587942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.590873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.593842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.597703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.620979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:42.655954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2357b2ef-2fc8-416e-ba31-beb3ec29e8c7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.371044 Jul 06 15:25:42.658213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 84/172] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:42 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:42.714615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-fdca77da-8b6b-4b78-9df8-9f473f7f94a1 req-b9c2007c-4f6b-4036-a8cb-caeb210cb7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3811251a-a0ba-4f29-9160-96c0f3f46c52", "name": "network-vif-plugged", "status": "completed", "tag": "fe67390d-68cb-4317-96a3-d85d3d7d6ff7"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:42.727638 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-fdca77da-8b6b-4b78-9df8-9f473f7f94a1 req-b9c2007c-4f6b-4036-a8cb-caeb210cb7b0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:42.728083 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-fdca77da-8b6b-4b78-9df8-9f473f7f94a1 req-b9c2007c-4f6b-4036-a8cb-caeb210cb7b0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:42.758442 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-fdca77da-8b6b-4b78-9df8-9f473f7f94a1 req-b9c2007c-4f6b-4036-a8cb-caeb210cb7b0 service nova] Creating event network-vif-plugged:fe67390d-68cb-4317-96a3-d85d3d7d6ff7 for instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 on hv-cinder-84884 Jul 06 15:25:42.764264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-fdca77da-8b6b-4b78-9df8-9f473f7f94a1 req-b9c2007c-4f6b-4036-a8cb-caeb210cb7b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054022 Jul 06 15:25:42.765481 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 85/173] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:42.868443 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:42.886509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-81c05694-9715-45e7-882c-6339096479bf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.322098 Jul 06 15:25:42.890118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 89/174] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:42 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:43.040777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "401ac023-24d2-475c-b720-0583e7d3b047"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:43.041932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:43.057508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.058883 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.063137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.066209 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.261452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:43.570496 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:43.571764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:43.587807 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.590469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.595572 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.609930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.908487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:43.917243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7b68dad9-2f90-469c-9311-f7a7b377b0b9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.350854 Jul 06 15:25:43.917828 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 90/175] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:43 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:43.923437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:43.924218 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:43.930334 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6a419a0e-9ab1-4016-9865-b120e5e4b489 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "POST /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893309 Jul 06 15:25:43.931693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.932488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.933639 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.934743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.935834 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 86/176] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:25:43 2022] POST /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:43.942385 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:43.943350 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:43.947716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=98 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:43.955965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.956783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:43.957824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:43.958451 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:44.126069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:44.134414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1020b003-46fd-4ea9-ada1-a2441d6ad325 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.215428 Jul 06 15:25:44.135004 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 91/177] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:43 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:44.289890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:44.299520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a605d85f-091c-4f2b-98e5-27d0005d7a08 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1363 microversion: 2.1 time: 0.362330 Jul 06 15:25:44.300423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 87/178] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:43 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:44.936437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:44.937347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:44.948262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:44.950937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:44.952207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:44.953277 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:44.988291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-a7a1979e-eff7-417c-9636-ba6e53b9e57b req-edfa1ea4-9fea-45f7-9df7-1bc95124c20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a347082e-a86f-46f0-a018-e3918e3e8262", "name": "network-vif-plugged", "status": "completed", "tag": "1517f5a9-ced9-4ab6-a63d-d158af2a6089"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:45.018040 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-a7a1979e-eff7-417c-9636-ba6e53b9e57b req-edfa1ea4-9fea-45f7-9df7-1bc95124c20b service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.020685 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-a7a1979e-eff7-417c-9636-ba6e53b9e57b req-edfa1ea4-9fea-45f7-9df7-1bc95124c20b service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.055717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-a7a1979e-eff7-417c-9636-ba6e53b9e57b req-edfa1ea4-9fea-45f7-9df7-1bc95124c20b service nova] Creating event network-vif-plugged:1517f5a9-ced9-4ab6-a63d-d158af2a6089 for instance a347082e-a86f-46f0-a018-e3918e3e8262 on hv-cinder-84884 Jul 06 15:25:45.063106 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-a7a1979e-eff7-417c-9636-ba6e53b9e57b req-edfa1ea4-9fea-45f7-9df7-1bc95124c20b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079150 Jul 06 15:25:45.064788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 88/179] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:45.152428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:45.153129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:45.165268 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.165713 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.166513 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.166962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.385039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:45.393233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c9a7581a-5287-4956-91f2-4c00180b9604 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.462402 Jul 06 15:25:45.403208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 92/180] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:44 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:45.410157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:45.411824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:45.418230 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.419400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.420364 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.420960 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.460320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:45.467781 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e48508a4-e05a-427f-9f61-c9a07c0fb69c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.319420 Jul 06 15:25:45.468332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 89/181] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:45 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:45.673160 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:45.682094 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b18b34c6-9c53-4be0-93fe-0137be37963a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1549 microversion: 2.1 time: 0.277318 Jul 06 15:25:45.692180 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 93/182] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:45 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1549 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:45.702940 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:45.704839 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:45.717035 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.718009 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.718938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:45.719559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:45.851443 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-318acf9a-ec30-4879-9639-aa1009576d00 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154490 Jul 06 15:25:45.852038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 90/183] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:25:45 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:46.411306 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-718564095", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:46.418310 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:46.420003 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:46.428058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:46.428761 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:46.430138 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:46.432149 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:46.473499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] validate_networks() for None {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:25:46.570965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:46.579942 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ee7d2eda-2ed2-4f60-ae17-3e427242d5dc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1367 microversion: 2.1 time: 0.173871 Jul 06 15:25:46.580789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 91/184] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:46 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:46.589415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:46.590273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:46.598222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:46.598679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:46.599805 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:46.600295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:46.736545 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:46.745054 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fab63f94-f1fb-4682-be6f-817727ef6e1d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.160103 Jul 06 15:25:46.745631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 92/185] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:46 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:46.989375 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1004317319", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "networks": [{"uuid": "29faeaee-d3c7-4625-83ea-4cacc91dc1a5"}]}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:47.046458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] validate_networks() for [('29faeaee-d3c7-4625-83ea-4cacc91dc1a5', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:25:47.142949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:25:47.143505 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:25:47.144121 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:25:47.144583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:25:47.145877 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:25:47.175772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.176535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.177350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.177784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.202813 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Getting quotas for project 56c6b45912e64ad691232fc05df8c123. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:25:47.208413 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Getting quotas for user 242a289932b34e06ac763d96c6315037 and project 56c6b45912e64ad691232fc05df8c123. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:25:47.226403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:25:47.231752 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:25:47.289551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f8275465-5a71-4e89-80dc-64f23f995b47 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888872 Jul 06 15:25:47.290232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 94/186] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 15:25:47.300732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a4cfba09-9612-4d55-8ecf-e7c7f4263615 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:47.302545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a4cfba09-9612-4d55-8ecf-e7c7f4263615 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:47.515778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:25:47.516342 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:25:47.516826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:25:47.517238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:25:47.517853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:25:47.528547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.528987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.529997 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.530436 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.562351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Getting quotas for project a75a2d018dff40bfb9b5bd72a678826c. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:25:47.568850 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Getting quotas for user 74581e9c5b27401686b40b2312a6f2fb and project a75a2d018dff40bfb9b5bd72a678826c. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:25:47.581658 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:25:47.583962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:25:47.616154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a4cfba09-9612-4d55-8ecf-e7c7f4263615 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:47.624400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a4cfba09-9612-4d55-8ecf-e7c7f4263615 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1214 microversion: 2.1 time: 0.328053 Jul 06 15:25:47.626405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 95/187] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:47 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:47.632287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:47.633031 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:47.640391 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.640966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.642074 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.642608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.652287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6872c9ca-d704-4228-8ebc-888f1c48937a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667782 Jul 06 15:25:47.653553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 93/188] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:25:47.669360 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b0dc77d0-7a92-4290-866d-d217f024e8b1 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:47.670929 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b0dc77d0-7a92-4290-866d-d217f024e8b1 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:47.732871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b0dc77d0-7a92-4290-866d-d217f024e8b1 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:47.741175 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b0dc77d0-7a92-4290-866d-d217f024e8b1 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1219 microversion: 2.1 time: 0.080906 Jul 06 15:25:47.743341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 94/189] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:47 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:47.763729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:47.764578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:47.772891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.773542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.774471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:47.775054 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:47.936357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:47.949767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-be749386-3d0f-443f-a08e-ff49ad051abd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.185626 Jul 06 15:25:47.949767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 95/190] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:47 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:48.019524 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:48.029882 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d97f60bb-688c-467d-b30b-652a54b3b68c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1557 microversion: 2.1 time: 0.402144 Jul 06 15:25:48.030897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 96/191] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:47 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1557 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:48.056789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:48.057597 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:48.066939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.067739 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.068803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.069383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.216017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4066c614-536c-4227-ae8d-94671f8f12af tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169802 Jul 06 15:25:48.217224 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 96/192] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:25:48 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:48.641864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:48.642610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:48.651697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.652263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.653148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.653668 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.816920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:48.829425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-781b3c41-f45a-40f7-ad35-3f0142e536a9 req-c56638e1-f0fa-4b59-a61b-8a18a69a078c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3811251a-a0ba-4f29-9160-96c0f3f46c52", "tag": "fe67390d-68cb-4317-96a3-d85d3d7d6ff7"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:48.836838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a0931f54-3145-4052-9708-3adcfeccd0bd tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1266 microversion: 2.1 time: 0.198682 Jul 06 15:25:48.855642 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 97/193] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:48 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:48.860546 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:48.860968 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-781b3c41-f45a-40f7-ad35-3f0142e536a9 req-c56638e1-f0fa-4b59-a61b-8a18a69a078c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.861597 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-781b3c41-f45a-40f7-ad35-3f0142e536a9 req-c56638e1-f0fa-4b59-a61b-8a18a69a078c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.867062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:48.885484 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.892129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-781b3c41-f45a-40f7-ad35-3f0142e536a9 req-c56638e1-f0fa-4b59-a61b-8a18a69a078c service nova] Creating event network-changed:fe67390d-68cb-4317-96a3-d85d3d7d6ff7 for instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 on hv-cinder-84884 Jul 06 15:25:48.894494 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.897242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.899762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.925095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-781b3c41-f45a-40f7-ad35-3f0142e536a9 req-c56638e1-f0fa-4b59-a61b-8a18a69a078c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244683 Jul 06 15:25:48.926139 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 97/194] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:25:48.962448 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:48.963253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:48.972333 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.973770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:48.977456 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:48.979144 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:49.035646 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:49.046352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3466762c-03c8-45bb-a625-c49b5f20e5ea tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1271 microversion: 2.1 time: 0.188460 Jul 06 15:25:49.056829 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 98/195] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:48 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:49.701198 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:49.709712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c9927ec1-06cd-401a-8813-3122205ce39b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.751392 Jul 06 15:25:49.710826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 98/196] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:48 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:49.872030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:49.873239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:49.881437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:49.882061 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:49.883172 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:49.883775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:49.959951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:49.968125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7827f8e1-0393-4bd3-8daa-d35f6119f75f tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1272 microversion: 2.1 time: 0.101971 Jul 06 15:25:49.968964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 99/197] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:49 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:50.065510 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:50.066211 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:50.087083 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:50.087377 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:50.088533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:50.088932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:50.536305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:50.545167 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2c114060-55d6-4205-a16b-05f256ca5706 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1277 microversion: 2.1 time: 0.484287 Jul 06 15:25:50.546421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 99/198] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:50 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1277 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:50.726658 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:50.727537 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:50.735479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:50.741824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:50.743044 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:50.744272 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:50.931657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:50.942386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-954f62dd-96dd-4b9a-b6f6-38e20ba3b964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.219775 Jul 06 15:25:50.943024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 100/199] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:50 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:50.994416 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:50.995905 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:51.010723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:51.012057 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:51.013639 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:51.014605 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:51.209655 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:51.220241 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-78f00e63-cf6e-4d40-9d39-377103b04286 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1272 microversion: 2.1 time: 0.235627 Jul 06 15:25:51.224500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 100/200] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:50 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:51.564509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:51.566080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:51.576182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:51.576895 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:51.577940 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:51.578943 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:51.648920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:51.658935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f521fc5c-3789-4cd3-9846-62d0b1648dbc tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1277 microversion: 2.1 time: 0.099735 Jul 06 15:25:51.669754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 101/201] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:51 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:51.968428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:51.969181 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:51.976396 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:51.977165 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:51.978110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:51.978708 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:52.244832 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:52.247045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:52.274433 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:52.275132 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:52.276122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:52.277817 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:52.402747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:52.414343 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2873efc2-c35d-4389-be9e-5defd48a63b9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1272 microversion: 2.1 time: 0.176918 Jul 06 15:25:52.424042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 102/202] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:52 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:52.479026 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1964325653", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "networks": [{"uuid": "f0e78724-aeff-41f2-91ec-9f159896885f"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:52.540873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] validate_networks() for [('f0e78724-aeff-41f2-91ec-9f159896885f', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:25:52.558810 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:52.573537 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-40c9c8b9-e5df-40cc-acff-ffb83d45a068 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.609642 Jul 06 15:25:52.574128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 101/203] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:51 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:52.578615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-a6271c01-1814-4b90-8208-6106efd21251 req-7e56fb4f-8230-4f77-8c15-fea0cc65ccb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a347082e-a86f-46f0-a018-e3918e3e8262", "tag": "1517f5a9-ced9-4ab6-a63d-d158af2a6089"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:52.595524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-a6271c01-1814-4b90-8208-6106efd21251 req-7e56fb4f-8230-4f77-8c15-fea0cc65ccb3 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:52.595973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-a6271c01-1814-4b90-8208-6106efd21251 req-7e56fb4f-8230-4f77-8c15-fea0cc65ccb3 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:52.615883 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-a6271c01-1814-4b90-8208-6106efd21251 req-7e56fb4f-8230-4f77-8c15-fea0cc65ccb3 service nova] Creating event network-changed:1517f5a9-ced9-4ab6-a63d-d158af2a6089 for instance a347082e-a86f-46f0-a018-e3918e3e8262 on hv-cinder-84884 Jul 06 15:25:52.630524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-a6271c01-1814-4b90-8208-6106efd21251 req-7e56fb4f-8230-4f77-8c15-fea0cc65ccb3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055191 Jul 06 15:25:52.631730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 102/204] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:52.684691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:52.688543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:52.697619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:52.698168 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:52.719789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:52.720444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.072199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:25:53.072804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:25:53.073458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:25:53.073996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:25:53.074817 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:25:53.093820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:53.095084 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.108009 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:53.108904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.132167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Getting quotas for project ee14fb4cfead402ab57d78792f303b48. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:25:53.136418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Getting quotas for user 857d941f699143ecbf25d842fb1f9ff8 and project ee14fb4cfead402ab57d78792f303b48. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:25:53.151101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:25:53.153718 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:25:53.206338 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e86e134e-269a-45e9-bcb0-c414944abceb tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733474 Jul 06 15:25:53.207743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 103/205] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:25:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:25:53.217834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-15c3f880-72e6-4070-9117-99513cff238d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:53.218876 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-15c3f880-72e6-4070-9117-99513cff238d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:53.295248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15c3f880-72e6-4070-9117-99513cff238d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:53.308307 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-15c3f880-72e6-4070-9117-99513cff238d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1214 microversion: 2.1 time: 0.094434 Jul 06 15:25:53.317634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 104/206] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:53 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:53.405045 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:53.426867 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e6f2e852-81d9-43be-b1bc-ebd48121a813 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.749917 Jul 06 15:25:53.427591 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 103/207] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:52 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:53.440595 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:53.442364 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:53.449956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:53.450727 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.451771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:53.452655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.591204 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:53.592572 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:53.600447 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:53.602716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.604398 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:53.605387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:53.713833 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:53.722664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f020349f-c7bf-4867-9637-5a7b131f9401 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.286034 Jul 06 15:25:53.727775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 105/208] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:53 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:54.074397 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:54.088559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:54.088760 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-015714f9-b11f-436e-aa65-371494a36976 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.501792 Jul 06 15:25:54.089909 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 104/209] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:53 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:54.095302 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:54.102695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.103470 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.104490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.105089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.136225 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:25:54.290466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-13bc0079-05e6-4e65-bc7b-5b073bbab5d2 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 204 len: 0 microversion: 2.1 time: 0.205825 Jul 06 15:25:54.291545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 106/210] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:25:54 2022] DELETE /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 15:25:54.300124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:54.300743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:54.306614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.307062 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.307854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.308519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.326571 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:54.327927 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:54.334260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.334936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.336320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.337053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.341989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:54.427474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:54.437462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-25403419-50a1-4c5e-aba0-5ceb39410c23 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1266 microversion: 2.1 time: 0.115859 Jul 06 15:25:54.449572 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 107/211] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:54 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:54.460991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:54.461893 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:54.470203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.470864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.472064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.472795 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.681527 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:54.689994 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4763133f-0fe1-4fb9-81ac-b80f33ddfc6e tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1552 microversion: 2.1 time: 0.394046 Jul 06 15:25:54.691962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 105/212] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:54 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1552 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:54.700625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:54.724558 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a9bcd755-a397-42dd-ad31-3d64403f9f8e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.273374 Jul 06 15:25:54.725168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 108/213] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:54 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:54.750061 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:54.751882 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:54.758288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.758736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.764439 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:54.764948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:54.796025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:55.082950 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:55.091495 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6cf93862-c6de-4c02-905c-93da7019bdd2 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.350833 Jul 06 15:25:55.100845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 106/214] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:54 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:55.105757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:55.106353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:55.112853 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.113294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.114142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.114459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.218887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-3a61d52c-161f-4d2a-9acb-de56daf0835b req-edf2b211-f808-4ea8-a6a7-b7cb4a5d28f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e28417-5f38-4197-bac2-c40ea4504b96", "tag": "9c43aeb6-467c-4668-8481-d8c12d840a81"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:55.231920 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-3a61d52c-161f-4d2a-9acb-de56daf0835b req-edf2b211-f808-4ea8-a6a7-b7cb4a5d28f4 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.232361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-3a61d52c-161f-4d2a-9acb-de56daf0835b req-edf2b211-f808-4ea8-a6a7-b7cb4a5d28f4 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.271753 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-3a61d52c-161f-4d2a-9acb-de56daf0835b req-edf2b211-f808-4ea8-a6a7-b7cb4a5d28f4 service nova] Creating event network-changed:9c43aeb6-467c-4668-8481-d8c12d840a81 for instance 44e28417-5f38-4197-bac2-c40ea4504b96 on hv-cinder-84884 Jul 06 15:25:55.277965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-3a61d52c-161f-4d2a-9acb-de56daf0835b req-edf2b211-f808-4ea8-a6a7-b7cb4a5d28f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063475 Jul 06 15:25:55.278962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 107/215] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:25:55.312773 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:55.321285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2ff46a82-e878-4a7e-b254-f0659e2987de tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.219229 Jul 06 15:25:55.321872 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 109/216] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:55 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:55.457340 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:55.458041 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:55.465159 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.465606 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.466365 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.466796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.531169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:55.538723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fae20237-f608-4c4a-a38b-2c4c9be7b1b2 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1274 microversion: 2.1 time: 0.086108 Jul 06 15:25:55.539425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 108/217] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:55 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:55.709142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:55.709746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:55.715654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.716100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.716852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.717282 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.741729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:55.742910 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:55.750897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.751545 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.752628 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:55.753361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:55.867768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:55.876860 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e41cabe6-beaf-493c-9ab8-a368f3d9b3f4 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1552 microversion: 2.1 time: 0.171424 Jul 06 15:25:55.877881 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 110/218] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:55 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:55.898190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:55.905491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-08761b2d-f144-447d-816d-25159105985b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.167801 Jul 06 15:25:55.906058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 109/219] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:55 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:56.110428 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:56.111269 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:56.119629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.120634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.122506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.123156 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.285406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:56.292946 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ab93f302-772b-4073-85c6-3fcc04c38582 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.186867 Jul 06 15:25:56.301249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 111/220] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:56 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:56.339836 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:56.340726 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:56.348087 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.348747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.349529 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.350238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.556598 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:56.557254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:56.564559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.565123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.566086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.566636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.637087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:56.648321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b0c10352-06f9-4f34-9f33-5a1abb5346b5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1272 microversion: 2.1 time: 0.095731 Jul 06 15:25:56.649199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 112/221] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:56 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:56.894624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:56.895372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:56.911347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.912239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:56.913255 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:56.913886 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.080481 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:57.089785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ef7a1a06-2fe4-4507-a9cf-96b0e49b1bfc tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1552 microversion: 2.1 time: 0.199455 Jul 06 15:25:57.090559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 113/222] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:56 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:57.099018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:57.099680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:57.106393 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.106824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.108055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.108055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.146647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:57.155444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-90489589-3015-4835-a41d-3de5c67364e4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.820135 Jul 06 15:25:57.157167 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 110/223] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:56 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:57.264202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:57.272814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dd78f7fb-4c2e-4502-bb1e-6b0309c4247a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.181080 Jul 06 15:25:57.273688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 114/224] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:57 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:57.299335 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-4e6f379e-ccb2-45a6-aee2-726311766a12 req-96cfec42-a157-4e3b-afc9-8dedf49838cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc61511-ad97-49b6-8127-d567909b6ebb", "tag": "74bf4e8a-6917-4bfa-85fd-a39eecbb576e"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:57.311160 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:57.311405 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-4e6f379e-ccb2-45a6-aee2-726311766a12 req-96cfec42-a157-4e3b-afc9-8dedf49838cf service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.311711 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-4e6f379e-ccb2-45a6-aee2-726311766a12 req-96cfec42-a157-4e3b-afc9-8dedf49838cf service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.312423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:57.319091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.319817 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.320801 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.321418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.330371 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-4e6f379e-ccb2-45a6-aee2-726311766a12 req-96cfec42-a157-4e3b-afc9-8dedf49838cf service nova] Creating event network-changed:74bf4e8a-6917-4bfa-85fd-a39eecbb576e for instance dbc61511-ad97-49b6-8127-d567909b6ebb on hv-cinder-84884 Jul 06 15:25:57.340986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-4e6f379e-ccb2-45a6-aee2-726311766a12 req-96cfec42-a157-4e3b-afc9-8dedf49838cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046189 Jul 06 15:25:57.341993 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 111/225] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:25:57.520846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:57.531495 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9e0f5afb-ca20-4e2a-9ccc-174a3566d3c9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.224947 Jul 06 15:25:57.532772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 115/226] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:57 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:57.667074 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:57.667812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:57.670214 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:57.677254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.677839 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.678751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:57.679400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:57.738004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=8 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:57.788304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:57.796529 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4ebc4713-8ed1-40cb-a1f2-32d8936cbf96 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1272 microversion: 2.1 time: 0.133474 Jul 06 15:25:57.797566 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 112/227] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:57 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:58.108728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:58.110571 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:58.116410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:58.120796 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.121448 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.122354 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.123675 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.173287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:58.174536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:58.181147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.181994 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.183148 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.183758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.235936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:58.250006 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-60427ec9-388a-4cf7-b442-ec212d5eda0a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1510 microversion: 2.1 time: 0.145732 Jul 06 15:25:58.251132 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 116/228] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:58 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:58.291769 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:58.294028 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:58.302149 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.302722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.304368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.304917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.370582 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:58.378592 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e67c40d3-ea00-401b-9ffe-7bcde3fb8139 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.209588 Jul 06 15:25:58.379150 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 113/229] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:58 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:58.488491 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:58.496058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5d402d5b-b1b8-4240-8833-828a27135f99 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.210055 Jul 06 15:25:58.496776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 117/230] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:58 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:58.549156 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:58.549842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:58.555756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.556269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.557095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.557585 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.815327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:58.816366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:58.826429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.827139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.828121 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:58.828704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:58.984192 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:58.993192 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cf580125-74b3-425d-9f7e-9288a4d3990d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.183207 Jul 06 15:25:58.995263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 118/231] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:58 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:59.251789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:59.260948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fe362eaa-f45f-40ee-9b05-96964d0ec39b tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.715683 Jul 06 15:25:59.262055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 114/232] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:58 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:59.268087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:59.269251 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:59.276244 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.276692 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.277518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.277954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.311551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.312224 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.312842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lazy-loading 'fault' on Instance uuid a60af238-6eb5-450e-adf6-2e01797e448c {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:25:59.372934 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-80624b29-c282-4f00-bbe7-f00d2690836d req-338ca7da-9e62-4c03-acc4-7dbea49d46bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60af238-6eb5-450e-adf6-2e01797e448c", "name": "network-vif-deleted", "tag": "ed64b6d5-5c31-4bdf-85ee-153655020dd2"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:25:59.374550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213ac803c2cb4cbfb4d73ec4fb07d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be64cd89e3b46738dca85e516a60d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:59.383365 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-09243d9f-5e82-4847-953a-aa360cf0572f tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 200 len: 1350 microversion: 2.1 time: 0.119028 Jul 06 15:25:59.384037 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 119/233] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:59 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:25:59.385074 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-80624b29-c282-4f00-bbe7-f00d2690836d req-338ca7da-9e62-4c03-acc4-7dbea49d46bd service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.385666 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-80624b29-c282-4f00-bbe7-f00d2690836d req-338ca7da-9e62-4c03-acc4-7dbea49d46bd service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.400581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:59.402382 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:59.404074 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-80624b29-c282-4f00-bbe7-f00d2690836d req-338ca7da-9e62-4c03-acc4-7dbea49d46bd service nova] Creating event network-vif-deleted:ed64b6d5-5c31-4bdf-85ee-153655020dd2 for instance a60af238-6eb5-450e-adf6-2e01797e448c on hv-cinder-84884 Jul 06 15:25:59.414464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.415173 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.416278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.416985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.419771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-80624b29-c282-4f00-bbe7-f00d2690836d req-338ca7da-9e62-4c03-acc4-7dbea49d46bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045864 Jul 06 15:25:59.423392 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 115/234] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:25:59.514937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:25:59.520315 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:25:59.529767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.532365 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.533362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:25:59.535590 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:25:59.627816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:59.635598 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5bdf6715-12d6-47dc-897c-df3feffe1731 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.244700 Jul 06 15:25:59.636860 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 120/235] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:59 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:25:59.936694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:25:59.948949 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a4122c35-e6ac-412e-8426-accb03cdf253 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.438106 Jul 06 15:25:59.960413 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:25:59 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:00.012122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:00.012806 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:00.020967 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.021488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.022316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.022968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.158150 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:00.167373 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6a3b4c04-0f64-4766-a719-5e7e6c2b43f6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.160048 Jul 06 15:26:00.168122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 121/237] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:00 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:00.278369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:00.279012 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:00.286337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.286853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.287639 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.288072 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.400415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:00.401111 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:00.408255 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.408848 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.409818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.410482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.426630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] HTTP exception thrown: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Request method failure captured: Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c HTTP/1.1 Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGgtMU6dJnubd5yfaqrYq_Xh6AqbZ1g_3HMMUGX6l8kcldzQo_vDsCPfrCeM9QH28Kf4DAOINas8RWZG1e_CFKuz_FuIrXbuLLqK02zqd5zzAXVA0q0aeKHgjlqIGICvE1QQVl4ppYevxpPRB7gCiG7Ze-WrqJ-rs8Kvud5zjXGwo Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:26:00.431703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 213ac803c2cb4cbfb4d73ec4fb07d552 Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.433198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'a60af238-6eb5-450e-adf6-2e01797e448c'} Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:00.434095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.435489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.436652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:00.436756 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Returning 404 to user: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:00.436756 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e94fea71-eba6-4fde-b673-e88eff45f962 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 404 len: 111 microversion: 2.1 time: 0.037682 Jul 06 15:26:00.436756 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 122/238] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:00 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:26:00.441097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b66e4b0b-f802-4f63-8562-63105ac91159 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.166475 Jul 06 15:26:00.441681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 117/239] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:00 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:00.543526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:00.544517 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:00.550646 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.551098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.551887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.552317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.565095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] HTTP exception thrown: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Request method failure captured: Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c/os-volume_attachments HTTP/1.1 Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGgtMU6dJnubd5yfaqrYq_Xh6AqbZ1g_3HMMUGX6l8kcldzQo_vDsCPfrCeM9QH28Kf4DAOINas8RWZG1e_CFKuz_FuIrXbuLLqK02zqd5zzAXVA0q0aeKHgjlqIGICvE1QQVl4ppYevxpPRB7gCiG7Ze-WrqJ-rs8Kvud5zjXGwo Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:26:00.566650 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 213ac803c2cb4cbfb4d73ec4fb07d552 Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.568125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'server_id': 'a60af238-6eb5-450e-adf6-2e01797e448c'} Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:00.568892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:00.570212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:00.571573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Returning 404 to user: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:00.571573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bdeb1f56-5d7e-4931-b4f2-5ce97fe5ae5a tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029185 Jul 06 15:26:00.571573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 123/240] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:26:00 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:26:00.652177 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:00.652782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:00.658905 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.659385 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.660165 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.660591 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.796599 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:00.804139 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-039191ee-7f04-4800-bc24-a7ac453a017f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.155758 Jul 06 15:26:00.804710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 118/241] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:00 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:00.967666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:00.968304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:00.983805 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.984381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:00.985710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:00.986150 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.127637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:01.131249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:01.136309 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0fab6425-a518-4855-bc68-4cfdd0897261 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.172851 Jul 06 15:26:01.136997 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 124/242] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:00 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:01.184949 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:01.185678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:01.194471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.194907 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.195705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.196136 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.383440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:01.390767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a6160a25-6df5-4899-aedf-08fc60d16cd1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.209633 Jul 06 15:26:01.391389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 119/243] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:01 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:01.436543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-38dfda56-0bba-41d8-af27-425772438e14 req-cfb35b4d-7e60-427f-a456-cded9560a9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7206b9c-b821-48d2-9be4-e11d41892f85", "tag": "6f85061a-6597-4b3f-8882-26dbe2aaf1df"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:01.444490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-38dfda56-0bba-41d8-af27-425772438e14 req-cfb35b4d-7e60-427f-a456-cded9560a9fb service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.444934 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-38dfda56-0bba-41d8-af27-425772438e14 req-cfb35b4d-7e60-427f-a456-cded9560a9fb service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.455497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-38dfda56-0bba-41d8-af27-425772438e14 req-cfb35b4d-7e60-427f-a456-cded9560a9fb service nova] Creating event network-changed:6f85061a-6597-4b3f-8882-26dbe2aaf1df for instance d7206b9c-b821-48d2-9be4-e11d41892f85 on hv-cinder-84884 Jul 06 15:26:01.457651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:01.458294 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:01.460356 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-38dfda56-0bba-41d8-af27-425772438e14 req-cfb35b4d-7e60-427f-a456-cded9560a9fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027831 Jul 06 15:26:01.460933 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 125/244] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:01.466557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.467037 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.467845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.468285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.595800 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:01.603646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-46ec2215-ff63-4b57-9279-7a10fd020662 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.149799 Jul 06 15:26:01.604341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 120/245] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:01 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:01.775240 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:01.775835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:01.782956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.783435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.784200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.784633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.797854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] HTTP exception thrown: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Request method failure captured: Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c HTTP/1.1 Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGgtMU6dJnubd5yfaqrYq_Xh6AqbZ1g_3HMMUGX6l8kcldzQo_vDsCPfrCeM9QH28Kf4DAOINas8RWZG1e_CFKuz_FuIrXbuLLqK02zqd5zzAXVA0q0aeKHgjlqIGICvE1QQVl4ppYevxpPRB7gCiG7Ze-WrqJ-rs8Kvud5zjXGwo Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:26:01.799511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 213ac803c2cb4cbfb4d73ec4fb07d552 Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.801002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'a60af238-6eb5-450e-adf6-2e01797e448c'} Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:01.801810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.803142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.804555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Returning 404 to user: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:01.804555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c164590d-5d3a-4be9-9dd1-e77d5d1e6679 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 404 len: 111 microversion: 2.1 time: 0.029873 Jul 06 15:26:01.804555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 126/246] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:26:01 2022] DELETE /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:26:01.809621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:01.810224 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] [instance: a60af238-6eb5-450e-adf6-2e01797e448c] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:01.816732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.817396 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.818219 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.818651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.821402 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:01.822022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:01.829921 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.830372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.831139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:01.831757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:01.833455 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] HTTP exception thrown: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Request method failure captured: Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c HTTP/1.1 Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGgtMU6dJnubd5yfaqrYq_Xh6AqbZ1g_3HMMUGX6l8kcldzQo_vDsCPfrCeM9QH28Kf4DAOINas8RWZG1e_CFKuz_FuIrXbuLLqK02zqd5zzAXVA0q0aeKHgjlqIGICvE1QQVl4ppYevxpPRB7gCiG7Ze-WrqJ-rs8Kvud5zjXGwo Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:26:01.838017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9be64cd89e3b46738dca85e516a60d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 9be64cd89e3b46738dca85e516a60d8a Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104881103 Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 213ac803c2cb4cbfb4d73ec4fb07d552 Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-DeleteServersTestJSON-2104881103-project Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.839337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'a60af238-6eb5-450e-adf6-2e01797e448c'} Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:01.840007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. Jul 06 15:26:01.841075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:01.842085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] Returning 404 to user: Instance a60af238-6eb5-450e-adf6-2e01797e448c could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:01.842085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-daff9563-b7b0-4cca-bedb-7cb78b7dbeb6 tempest-DeleteServersTestJSON-2104881103 tempest-DeleteServersTestJSON-2104881103-project] 10.222.0.46 "GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c" status: 404 len: 111 microversion: 2.1 time: 0.033612 Jul 06 15:26:01.842085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 121/247] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:01 2022] GET /compute/v2.1/servers/a60af238-6eb5-450e-adf6-2e01797e448c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:26:02.094746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:02.102332 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a5d351e9-f2b0-4b4a-8c00-7527ebead521 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.284841 Jul 06 15:26:02.103008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 127/248] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:01 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:02.153430 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:02.154326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:02.161102 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:02.161582 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:02.162357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:02.162793 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:02.306050 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:02.314490 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7e7b91a5-0b33-42e9-aed4-137e8ad8e7b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.165541 Jul 06 15:26:02.315054 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 122/249] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:02 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:02.408366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:02.409169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:02.418348 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:02.418832 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:02.419793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:02.420224 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:02.621890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:02.622595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:02.629236 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:02.629743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:02.630601 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:02.631034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:02.797230 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:02.805899 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9a4c515a-968e-4529-b899-befca7dcfae1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.402022 Jul 06 15:26:02.806485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 128/250] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:02 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:02.869578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:02.878105 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f6c4ce73-912f-454e-822f-37b631b62a82 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.260099 Jul 06 15:26:02.878670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 123/251] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:02 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:03.121971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:03.128946 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:03.132418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:03.138017 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.139071 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.140202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.140838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.301215 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=16 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:03.332913 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:03.333538 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:03.340269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.340719 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.341677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.342292 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.392429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:03.401240 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ab1a56af-9a78-4fdf-9d40-2d65daee66c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.285112 Jul 06 15:26:03.402094 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 129/252] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:03 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:03.507361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:03.515665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-87931514-d221-4232-b70b-745125540062 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.187586 Jul 06 15:26:03.519466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:03 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:03.823685 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:03.824286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:03.830741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.831423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.832188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.832615 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.895129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:03.897432 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:03.905913 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.908693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:03.909797 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:03.911706 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:04.097825 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:04.102410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:04.116517 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ce54969d-2b48-4e45-a9b1-ecaddc7b506a tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.225460 Jul 06 15:26:04.117667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 125/254] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:03 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:04.227086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:04.258749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f34e484e-57a8-44a6-b905-4068a93e923d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.438953 Jul 06 15:26:04.260100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 130/255] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:03 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:04.281076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-d032c821-3995-4927-b916-6bc27590dc53 req-afa4d7f0-e29d-4855-b53f-d9f73abd2719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc61511-ad97-49b6-8127-d567909b6ebb", "name": "network-vif-plugged", "status": "completed", "tag": "74bf4e8a-6917-4bfa-85fd-a39eecbb576e"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:04.291103 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-d032c821-3995-4927-b916-6bc27590dc53 req-afa4d7f0-e29d-4855-b53f-d9f73abd2719 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:04.291789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-d032c821-3995-4927-b916-6bc27590dc53 req-afa4d7f0-e29d-4855-b53f-d9f73abd2719 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:04.315986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-d032c821-3995-4927-b916-6bc27590dc53 req-afa4d7f0-e29d-4855-b53f-d9f73abd2719 service nova] Creating event network-vif-plugged:74bf4e8a-6917-4bfa-85fd-a39eecbb576e for instance dbc61511-ad97-49b6-8127-d567909b6ebb on hv-cinder-84884 Jul 06 15:26:04.324778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-d032c821-3995-4927-b916-6bc27590dc53 req-afa4d7f0-e29d-4855-b53f-d9f73abd2719 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046798 Jul 06 15:26:04.325737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 126/256] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:04.417827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:04.418702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:04.427634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:04.430508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:04.431501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:04.432089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:04.534915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:04.535242 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:04.541803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:04.543104 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:04.544330 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:04.544469 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:04.770950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:04.781351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ac3a4bf5-c838-4dec-9282-78ae9aad524a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.367031 Jul 06 15:26:04.782072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 131/257] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:04 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:04.860761 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:04.868958 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d8713322-1b84-4792-b165-43e7da533686 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.339956 Jul 06 15:26:04.871548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 127/258] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:04 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:05.139510 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:05.140123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:05.147520 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.147967 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.148745 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.149174 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.275822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:05.276431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:05.285838 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.286965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.288474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.289112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.370999 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:05.378965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f3605b52-9b1c-487c-bbc5-e99539263cb9 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.243629 Jul 06 15:26:05.379589 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 132/259] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:05 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:05.530776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:05.538881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8ee1dc7d-5b4d-41e7-9c69-a1af21a7f61f tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.267080 Jul 06 15:26:05.539491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 128/260] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:05 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:05.798651 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:05.799739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:05.807055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.807647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.808348 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.808776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.891260 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:05.892618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:05.896299 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:05.901956 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.907990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:05.910897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:05.911393 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:06.011079 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:06.026988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e4a40331-9519-4d78-9d39-60d12f084506 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.231454 Jul 06 15:26:06.027748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 133/261] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:05 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:06.165534 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:06.173911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f288352a-f32c-414b-b65b-87ea2bd49ac0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1319 microversion: 2.1 time: 0.289706 Jul 06 15:26:06.174770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 129/262] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:05 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:06.395393 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:06.396035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:06.409840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:06.410289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:06.411071 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:06.411562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:06.434277 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-5cf46a08-1986-4a2a-852b-fd10cc92c0d9 req-a64597a8-7df1-4810-b149-6b08e21423c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e28417-5f38-4197-bac2-c40ea4504b96", "name": "network-vif-plugged", "status": "completed", "tag": "9c43aeb6-467c-4668-8481-d8c12d840a81"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:06.450812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5cf46a08-1986-4a2a-852b-fd10cc92c0d9 req-a64597a8-7df1-4810-b149-6b08e21423c1 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:06.451290 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5cf46a08-1986-4a2a-852b-fd10cc92c0d9 req-a64597a8-7df1-4810-b149-6b08e21423c1 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:06.467782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-5cf46a08-1986-4a2a-852b-fd10cc92c0d9 req-a64597a8-7df1-4810-b149-6b08e21423c1 service nova] Creating event network-vif-plugged:9c43aeb6-467c-4668-8481-d8c12d840a81 for instance 44e28417-5f38-4197-bac2-c40ea4504b96 on hv-cinder-84884 Jul 06 15:26:06.473620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-5cf46a08-1986-4a2a-852b-fd10cc92c0d9 req-a64597a8-7df1-4810-b149-6b08e21423c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058248 Jul 06 15:26:06.474759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 130/263] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:06.557580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:06.559912 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:06.570588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:06.571056 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:06.577668 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:06.578352 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:06.651643 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:06.663742 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-664ca9f2-2b63-4757-9166-1f05ce699d9d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.271527 Jul 06 15:26:06.664992 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 134/264] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:06 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:06.909784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:06.920900 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-441af459-59de-4719-af78-f841481c493d tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.368717 Jul 06 15:26:06.929508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 131/265] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:06 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:07.044490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:07.045109 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:07.051081 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.051574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.052350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.052780 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.191369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:07.192086 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:07.198225 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.198677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.199466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.199905 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.246330 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:07.270244 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-68d619d1-7425-4019-b27d-d39844244643 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.229735 Jul 06 15:26:07.271298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 135/266] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:07 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:07.371320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:07.372205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2e9007b3-934b-4c60-8e09-4391446bbe30 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1507 microversion: 2.1 time: 0.184793 Jul 06 15:26:07.372771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 132/267] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:07 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:07.682569 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:07.683303 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:07.690045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.690661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.692204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.692629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.872366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:07.882004 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bf379632-7944-4a53-9b27-d18a6c8d14ce tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.203296 Jul 06 15:26:07.883403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 136/268] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:07 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:07.939540 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:07.940147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:07.947811 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.948950 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:07.949876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:07.950640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:08.253687 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:08.264078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ab68902b-0365-4c9d-8697-4c1498ecb89c tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.329263 Jul 06 15:26:08.268537 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 133/269] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:07 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:08.289309 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:08.290162 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:08.298989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:08.300041 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:08.300835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:08.301284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:08.466422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:08.475372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ff1b56a9-4a1b-4950-8d96-c5a3f1af4143 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.190615 Jul 06 15:26:08.475961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 137/270] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:08 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:08.492987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-d1754413-9db5-4703-8ee0-d95289117377 req-918b787d-ac30-417f-b243-96369f84b8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7206b9c-b821-48d2-9be4-e11d41892f85", "name": "network-vif-plugged", "status": "completed", "tag": "6f85061a-6597-4b3f-8882-26dbe2aaf1df"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:08.501702 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-d1754413-9db5-4703-8ee0-d95289117377 req-918b787d-ac30-417f-b243-96369f84b8c8 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:08.502378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-d1754413-9db5-4703-8ee0-d95289117377 req-918b787d-ac30-417f-b243-96369f84b8c8 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:08.513679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-d1754413-9db5-4703-8ee0-d95289117377 req-918b787d-ac30-417f-b243-96369f84b8c8 service nova] Creating event network-vif-plugged:6f85061a-6597-4b3f-8882-26dbe2aaf1df for instance d7206b9c-b821-48d2-9be4-e11d41892f85 on hv-cinder-84884 Jul 06 15:26:08.518543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-d1754413-9db5-4703-8ee0-d95289117377 req-918b787d-ac30-417f-b243-96369f84b8c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029332 Jul 06 15:26:08.519132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 134/271] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:08.900001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:08.901024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:08.909248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:08.909763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:08.910663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:08.911183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:09.047426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:09.056431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3a92a46b-699d-430d-be43-a61cfef66b56 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1314 microversion: 2.1 time: 0.160252 Jul 06 15:26:09.057145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 138/272] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:08 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:09.284357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:09.285085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:09.291239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:09.291706 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:09.292470 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:09.292908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:09.425603 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:09.433281 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-43cd42ee-b1da-4762-90a7-871cd212ed94 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.154654 Jul 06 15:26:09.433841 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 135/273] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:09 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:09.492509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:09.493129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:09.499028 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:09.499518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:09.500270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:09.500734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:09.633672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:09.641101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b156851-a116-4643-977a-8e0ce6493947 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.152418 Jul 06 15:26:09.642322 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 139/274] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:09 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:10.073785 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:10.074391 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:10.080387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.080833 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.081586 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.082022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.215955 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:10.223720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8bd4c34e-7aef-4fa2-991f-9ad55e352064 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1464 microversion: 2.1 time: 0.153792 Jul 06 15:26:10.224781 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 136/275] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:10 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:10.268054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:10.268545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:10.274536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.274989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.275765 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.276198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.301190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:26:10.377762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-417ba1ed-82ac-4db6-8136-ffec16207778 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 204 len: 0 microversion: 2.1 time: 0.113235 Jul 06 15:26:10.378352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 140/276] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:26:10 2022] DELETE /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:26:10.386805 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:10.388035 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:10.394590 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.395064 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.396038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.396591 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.450580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:10.451561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:10.458565 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.459456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.460462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.461048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.465671 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:10.599525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:10.608201 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-12895bbb-ce0d-474f-abfe-10edfda8e28d tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1470 microversion: 2.1 time: 0.225385 Jul 06 15:26:10.608781 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 137/277] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:10 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:10.638509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:10.646662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9251cc05-e05b-4979-a3ca-e93e7510acda tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.200333 Jul 06 15:26:10.647402 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 141/278] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:10 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:10.660600 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:10.661294 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:10.667378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.667831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.668644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:10.669064 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:10.802778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:10.811159 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-48b59763-ea2c-482e-88df-e859f176c2f5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1523 microversion: 2.1 time: 0.157147 Jul 06 15:26:10.812178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 138/279] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:10 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:11.626595 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:11.627310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:11.633355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:11.633800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:11.634557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:11.634993 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:11.665167 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:11.665798 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:11.672431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:11.673378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:11.674151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:11.674596 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:11.791093 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:11.799551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-228f4a1b-c9af-40da-b332-4830f214744c tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1470 microversion: 2.1 time: 0.177294 Jul 06 15:26:11.800137 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 142/280] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:11 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:11.827793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:11.828620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:11.835712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:11.836145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:11.836972 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:11.837332 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:11.857139 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:11.865770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-82d6f915-3102-4681-97a8-461e4a7ce263 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.205943 Jul 06 15:26:11.866353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 139/281] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:11 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:11.980463 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:11.988963 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e0cabbc5-b9ad-46f3-b364-d3e790677e54 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1503 microversion: 2.1 time: 0.164973 Jul 06 15:26:11.989545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 143/282] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:11 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:12.004681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:12.005295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:12.011301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:12.011753 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:12.012514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:12.012953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:12.152234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:12.160413 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-071887c2-94a1-46b4-9914-822e9895130a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1516 microversion: 2.1 time: 0.159610 Jul 06 15:26:12.160977 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 140/283] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:11 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:12.817373 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:12.817978 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:12.823951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:12.824425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:12.825167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:12.825595 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:12.882440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:12.883166 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:12.889859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:12.890324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:12.891164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:12.892236 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:12.956488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:12.964660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5fecf8d9-408c-4962-9ed2-371ba5f29834 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1470 microversion: 2.1 time: 0.151643 Jul 06 15:26:12.965242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 144/284] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:12 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:13.020385 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:13.027716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-154dfed4-cebc-467b-95a2-94bffc07d72a tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.149215 Jul 06 15:26:13.028273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 141/285] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:12 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:13.981217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:13.981880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:13.988434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:13.988876 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:13.989622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:13.990045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:14.044192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:14.044930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:14.053001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:14.053555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:14.055279 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:14.055750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:14.125535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:14.133329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6656dd6d-e4e5-4fa9-a743-9a143fc631d1 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1470 microversion: 2.1 time: 0.155803 Jul 06 15:26:14.134105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 145/286] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:13 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:14.195612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:14.202934 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-882aa14e-44af-46ac-84de-0443f3237527 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.162618 Jul 06 15:26:14.203526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 142/287] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:14 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:15.150311 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:15.150896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:15.157099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:15.157541 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:15.158310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:15.158732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:15.219519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:15.220210 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:15.226522 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:15.226972 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:15.227787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:15.228220 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:15.288704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:15.296905 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0d6d151f-d798-4bac-ba24-437fda3fb221 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1470 microversion: 2.1 time: 0.150371 Jul 06 15:26:15.298069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 146/288] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:15 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:15.357484 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:15.365466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-de893613-3aa6-4be3-8f03-749d65fdbd2b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.149745 Jul 06 15:26:15.366030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 143/289] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:15 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:16.315143 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:16.316902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:16.323404 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.323880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.324814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.325248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.386077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:16.387169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:16.397555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.398311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.399421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.400213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.463211 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:16.532003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:16.539961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d01db923-05ba-4f49-b616-53371eddb398 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1470 microversion: 2.1 time: 0.229806 Jul 06 15:26:16.540548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:16 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:16.547923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-571075e8-396e-4571-8bdb-3b30e2f1a025 req-9efadeff-33a0-4636-aaf5-b2ae3a880129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e28417-5f38-4197-bac2-c40ea4504b96", "name": "network-vif-deleted", "tag": "9c43aeb6-467c-4668-8481-d8c12d840a81"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:16.561538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-571075e8-396e-4571-8bdb-3b30e2f1a025 req-9efadeff-33a0-4636-aaf5-b2ae3a880129 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.562190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-571075e8-396e-4571-8bdb-3b30e2f1a025 req-9efadeff-33a0-4636-aaf5-b2ae3a880129 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.580309 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-571075e8-396e-4571-8bdb-3b30e2f1a025 req-9efadeff-33a0-4636-aaf5-b2ae3a880129 service nova] Creating event network-vif-deleted:9c43aeb6-467c-4668-8481-d8c12d840a81 for instance 44e28417-5f38-4197-bac2-c40ea4504b96 on hv-cinder-84884 Jul 06 15:26:16.587070 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-571075e8-396e-4571-8bdb-3b30e2f1a025 req-9efadeff-33a0-4636-aaf5-b2ae3a880129 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042642 Jul 06 15:26:16.588181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 148/291] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:16.644417 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:16.658629 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-498d24b9-fae3-429c-b352-36c6a5d48a36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1314 microversion: 2.1 time: 0.279394 Jul 06 15:26:16.659575 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 144/292] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:16 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:16.821035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:16.822342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:16.828584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.829035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.829791 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.830223 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.852562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'flavor' on Instance uuid ce440c64-f3db-4cda-8a2f-0f7e00f36b30 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:26:16.961848 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d78a6f9e-51a3-48b7-bb24-888bc9c2a560 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/action" status: 200 len: 32 microversion: 2.1 time: 0.145060 Jul 06 15:26:16.962441 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 149/293] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:26:16 2022] POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:26:16.971515 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:16.972156 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:16.978067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.978512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:16.979288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:16.979723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:17.112737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:17.120077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bdf8c01d-1460-4460-b673-932e4a17ff2e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.152433 Jul 06 15:26:17.120634 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 145/294] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:16 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:17.558769 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:17.559480 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:17.565590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:17.566029 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:17.566777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:17.567275 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:17.598869 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:17.599359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:17.599796 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lazy-loading 'fault' on Instance uuid 44e28417-5f38-4197-bac2-c40ea4504b96 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:26:17.649177 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242a289932b34e06ac763d96c6315037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c6b45912e64ad691232fc05df8c123', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:17.653093 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-39342112-dc26-4215-b52d-357ef23d2ea4 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 200 len: 1304 microversion: 2.1 time: 0.098443 Jul 06 15:26:17.654003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 150/295] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:17 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:17.676087 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:17.676704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:17.683493 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:17.683822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:17.684589 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:17.685020 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:17.814637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:17.822310 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1c377458-e727-4f6b-b734-933d9e983bfe tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1498 microversion: 2.1 time: 0.150204 Jul 06 15:26:17.822816 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 146/296] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:17 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:18.139261 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:18.140296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:18.148417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.149181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.150030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.150676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.305715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:18.314322 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-30e3987e-63ca-4825-a2bc-41f7f71a8b5d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.180054 Jul 06 15:26:18.315189 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 151/297] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:18 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:18.456858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:18.457361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:18.463462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.463911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.464731 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.465246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.492644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Going to try to terminate instance {{(pid=117620) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:26:18.590842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-338b020c-e9b5-421e-acf0-2a2f093979d3 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 204 len: 0 microversion: 2.1 time: 0.137512 Jul 06 15:26:18.591471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 147/298] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:26:18 2022] DELETE /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:26:18.600335 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:18.600975 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:18.607021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.607501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.608295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.608726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.673392 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:18.674092 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] [instance: 44e28417-5f38-4197-bac2-c40ea4504b96] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:18.680484 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.681038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.681669 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:18.682099 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:18.695343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] HTTP exception thrown: Instance 44e28417-5f38-4197-bac2-c40ea4504b96 could not be found. Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Request method failure captured: Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 HTTP/1.1 Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixal4AZLKkB5GQJbTxLiylPIDvFslHfd48HS6rWr5NmB9NA8boElxassxzluST-9ivWMLMV1gFEaETYq3J9ZtTB8lBPaPBvthc4IApJ0CXEA3ry0xmb1mJtq0rsdcxQWw3JUuXR-dMS8QJsO9SSqvJ6NCbzJWaCTOO7tfIYIeF-rRhXc Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 56c6b45912e64ad691232fc05df8c123 Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesNegativeTest-909217270 Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:26:18.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c6b45912e64ad691232fc05df8c123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c6b45912e64ad691232fc05df8c123"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c6b45912e64ad691232fc05df8c123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c6b45912e64ad691232fc05df8c123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesNegativeTest-909217270 Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 56c6b45912e64ad691232fc05df8c123 Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesNegativeTest-909217270 Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesNegativeTest-909217270-project Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 242a289932b34e06ac763d96c6315037 Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesNegativeTest-909217270-project Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 44e28417-5f38-4197-bac2-c40ea4504b96 could not be found. Jul 06 15:26:18.698421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '44e28417-5f38-4197-bac2-c40ea4504b96'} Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e28417-5f38-4197-bac2-c40ea4504b96 could not be found. Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:18.699178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e28417-5f38-4197-bac2-c40ea4504b96 could not be found. Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e28417-5f38-4197-bac2-c40ea4504b96 could not be found. Jul 06 15:26:18.700497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:18.701640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] Returning 404 to user: Instance 44e28417-5f38-4197-bac2-c40ea4504b96 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:18.701640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6ecd180b-9060-43c6-b170-c3c7436d2027 tempest-VolumesNegativeTest-909217270 tempest-VolumesNegativeTest-909217270-project] 10.222.0.46 "GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96" status: 404 len: 111 microversion: 2.1 time: 0.029890 Jul 06 15:26:18.701640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 148/299] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:18 2022] GET /compute/v2.1/servers/44e28417-5f38-4197-bac2-c40ea4504b96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:26:18.748995 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:18.756763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3226a40e-33e5-491d-9dd9-3c73264668a4 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1504 microversion: 2.1 time: 0.160438 Jul 06 15:26:18.757556 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 152/300] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:18 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:19.333751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:19.334443 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:19.340730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:19.341256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:19.342171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:19.342670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:19.530796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:19.539381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-85dd6068-e69c-470e-8b58-253e9d149263 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.211133 Jul 06 15:26:19.540084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 149/301] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:19 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:19.773602 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:19.774816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:19.782174 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:19.782618 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:19.783724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:19.784282 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:19.958037 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:19.966341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-44162edf-ad57-4ce4-8134-a0d54387b2d9 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1504 microversion: 2.1 time: 0.196424 Jul 06 15:26:19.966937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 153/302] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:19 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:20.557052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:20.558255 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:20.566171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:20.566823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:20.567872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:20.568597 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:20.759063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:20.767309 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-496cf309-6c20-43c9-8d8b-6dc7cf6cb084 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.214279 Jul 06 15:26:20.767884 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 150/303] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:20 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:20.983754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:20.984368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:20.992251 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:20.992827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:20.994208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:20.995396 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:21.285119 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-b83569aa-0d0f-4017-a0c2-56675eddb680 req-a80681a1-33af-4a80-a5b9-88ce2a913508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7206b9c-b821-48d2-9be4-e11d41892f85", "name": "network-vif-deleted", "tag": "6f85061a-6597-4b3f-8882-26dbe2aaf1df"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:21.286339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:21.295043 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-b83569aa-0d0f-4017-a0c2-56675eddb680 req-a80681a1-33af-4a80-a5b9-88ce2a913508 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:21.295819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-b83569aa-0d0f-4017-a0c2-56675eddb680 req-a80681a1-33af-4a80-a5b9-88ce2a913508 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:21.302159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-737ec1f0-8c42-40f2-89e0-29b8ca609a42 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 200 len: 1504 microversion: 2.1 time: 0.322342 Jul 06 15:26:21.304854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 154/304] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:20 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:21.329531 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-b83569aa-0d0f-4017-a0c2-56675eddb680 req-a80681a1-33af-4a80-a5b9-88ce2a913508 service nova] Creating event network-vif-deleted:6f85061a-6597-4b3f-8882-26dbe2aaf1df for instance d7206b9c-b821-48d2-9be4-e11d41892f85 on hv-cinder-84884 Jul 06 15:26:21.338804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-b83569aa-0d0f-4017-a0c2-56675eddb680 req-a80681a1-33af-4a80-a5b9-88ce2a913508 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057294 Jul 06 15:26:21.343052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 151/305] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:21.783784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:21.784404 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:21.791688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:21.792091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:21.792845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:21.793283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:22.005750 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:22.017855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-12cd813e-0c39-4aaf-a434-4e506eacc621 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.238559 Jul 06 15:26:22.022894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 155/306] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:21 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:22.325452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:22.326212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: d7206b9c-b821-48d2-9be4-e11d41892f85] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:22.333112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:22.333554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:22.334303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:22.334727 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:22.347697 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] HTTP exception thrown: Instance d7206b9c-b821-48d2-9be4-e11d41892f85 could not be found. Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Request method failure captured: Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 HTTP/1.1 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixal-tDXAVcp-fd4cAJoxl2ZOyI8EiYJ0xA_gB_r7MwNU_ytcAx6BXoBZNrSM00h8ylf3GfY_NhO0lR4qL1NMqP8oSYMkA0YrcE3-TW8P1CC17gmAzHKFjHO7TzLBI3ZX99gtCUE8ehOPlhrqXu6zezOfMUFWbRtl5H-aOzRlljUAq28 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: ee14fb4cfead402ab57d78792f303b48 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesActionsTest-974457274 Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:26:22.349804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesActionsTest-974457274 Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: ee14fb4cfead402ab57d78792f303b48 Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesActionsTest-974457274 Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesActionsTest-974457274-project Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 857d941f699143ecbf25d842fb1f9ff8 Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesActionsTest-974457274-project Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance d7206b9c-b821-48d2-9be4-e11d41892f85 could not be found. Jul 06 15:26:22.351354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'd7206b9c-b821-48d2-9be4-e11d41892f85'} Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7206b9c-b821-48d2-9be4-e11d41892f85 could not be found. Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:22.352208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7206b9c-b821-48d2-9be4-e11d41892f85 could not be found. Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7206b9c-b821-48d2-9be4-e11d41892f85 could not be found. Jul 06 15:26:22.353749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:26:22.354993 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Returning 404 to user: Instance d7206b9c-b821-48d2-9be4-e11d41892f85 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:22.354993 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ee7ee53c-5f34-4431-bddd-95d3323feb36 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85" status: 404 len: 111 microversion: 2.1 time: 0.031110 Jul 06 15:26:22.354993 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 152/307] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:22 2022] GET /compute/v2.1/servers/d7206b9c-b821-48d2-9be4-e11d41892f85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:26:22.523838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-811500076", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "networks": [{"uuid": "f0e78724-aeff-41f2-91ec-9f159896885f"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:22.586155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] validate_networks() for [('f0e78724-aeff-41f2-91ec-9f159896885f', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:26:22.954118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:26:22.954535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:26:22.955059 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:26:22.955522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:26:22.955960 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:26:22.964573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:22.965019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:22.966002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:22.966505 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:22.976088 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:22.989136 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Getting quotas for project ee14fb4cfead402ab57d78792f303b48. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:26:22.993122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Getting quotas for user 857d941f699143ecbf25d842fb1f9ff8 and project ee14fb4cfead402ab57d78792f303b48. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:26:23.002370 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:23.004840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:26:23.007341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:26:23.036230 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:23.036847 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:23.043319 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:23.043773 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:23.044542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:23.044975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:23.052249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bb4402dc-3435-4fad-8c72-792614480798 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532365 Jul 06 15:26:23.053167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 156/308] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:26:23.066106 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8a3fe2a6-95ac-4c77-b1da-e86b748d6c72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:23.066903 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8a3fe2a6-95ac-4c77-b1da-e86b748d6c72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:23.138953 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8a3fe2a6-95ac-4c77-b1da-e86b748d6c72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:23.147075 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8a3fe2a6-95ac-4c77-b1da-e86b748d6c72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1213 microversion: 2.1 time: 0.086240 Jul 06 15:26:23.148703 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 157/309] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:23 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:23.245341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:23.254974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ee98dd65-625e-4962-be1b-7b44846242a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.224264 Jul 06 15:26:23.257052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 153/310] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:23 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:24.164790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:24.165381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:24.171799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:24.172797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:24.173806 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:24.174226 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:24.267126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:24.274149 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:24.275615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:24.276771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6ef8a175-91ec-47df-aceb-1b6033a9f441 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1265 microversion: 2.1 time: 0.115849 Jul 06 15:26:24.285640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:24.286112 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 158/311] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:24 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:24.287071 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:24.288552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:24.289761 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:24.548050 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:24.559929 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e7c67233-e8d7-4b99-b852-0a884363dd3d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.290434 Jul 06 15:26:24.560731 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 154/312] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:24 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:25.295328 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:25.295847 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:25.304967 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:25.305440 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:25.306249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:25.306688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:25.494407 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:25.508759 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-18014040-7118-40ab-96e4-751759b0a315 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.217517 Jul 06 15:26:25.510416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 159/313] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:25 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:25.578277 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:25.580149 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:25.592462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:25.593218 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:25.594999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:25.597304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:25.900265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:25.909649 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1ac956e1-ac63-4c08-8d82-3209ab210c6c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.335877 Jul 06 15:26:25.915646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 155/314] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:25 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:26.294223 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-3eae444e-35f5-457b-84d7-1ef0aa010761 req-cf5ca4c3-9619-4b3c-8b92-967b8d8377cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeea6136-04c3-4d1f-8e59-a33186b6630f", "tag": "b7618127-2732-465e-886a-0fab54e544e7"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:26.323422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3eae444e-35f5-457b-84d7-1ef0aa010761 req-cf5ca4c3-9619-4b3c-8b92-967b8d8377cf service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:26.324074 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3eae444e-35f5-457b-84d7-1ef0aa010761 req-cf5ca4c3-9619-4b3c-8b92-967b8d8377cf service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:26.340331 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-3eae444e-35f5-457b-84d7-1ef0aa010761 req-cf5ca4c3-9619-4b3c-8b92-967b8d8377cf service nova] Creating event network-changed:b7618127-2732-465e-886a-0fab54e544e7 for instance aeea6136-04c3-4d1f-8e59-a33186b6630f on hv-cinder-84884 Jul 06 15:26:26.346557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-3eae444e-35f5-457b-84d7-1ef0aa010761 req-cf5ca4c3-9619-4b3c-8b92-967b8d8377cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057782 Jul 06 15:26:26.347955 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 160/315] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:26.525996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:26.526614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:26.540507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:26.541527 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:26.542651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:26.543101 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:26.934308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:26.939845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:26.953325 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:26.957257 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:26.958169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:26.959550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:27.046025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:27.062312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e1b1b121-ca1d-4e7e-a02a-d50744dfa1f1 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.539617 Jul 06 15:26:27.063274 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 156/316] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:26 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:27.221795 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:27.235543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0aef2360-418e-4fa2-ad5a-98f7b94f4dd5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.304272 Jul 06 15:26:27.239522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 161/317] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:26 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:28.081392 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:28.082251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:28.091854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:28.109180 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:28.110897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:28.111582 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:28.255112 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:28.256534 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:28.268434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:28.268878 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:28.280449 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:28.281679 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:28.464214 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:28.473833 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f458f846-f58a-44c9-bcd6-43403dc8ad5b tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.396611 Jul 06 15:26:28.474421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 157/318] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:28 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:28.559956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:28.571506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e940a0a2-56c4-4836-b5d0-5961eea4662a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.320446 Jul 06 15:26:28.588022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 162/319] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:28 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:29.495339 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:29.497166 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:29.508559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:29.509710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:29.510806 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:29.511546 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:29.590051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:29.592009 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:29.599902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:29.600660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:29.601981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:29.602799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:29.749215 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:29.761539 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-068d5355-30b8-49f8-9d9b-122d14e94993 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.274385 Jul 06 15:26:29.772570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 158/320] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:29 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:29.838758 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:29.854898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-13495436-45c4-4616-bc3c-d6f459fa6459 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.269829 Jul 06 15:26:29.857166 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 163/321] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:29 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:30.780137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:30.788134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:30.799455 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:30.802310 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:30.804507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:30.805233 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:30.873445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:30.874116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:30.889575 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:30.890024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:30.890851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:30.891310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:31.049476 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:31.059636 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-334e19fb-411a-46ff-935f-7dc0e845e875 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.283207 Jul 06 15:26:31.069492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 159/322] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:30 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:31.182614 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:31.192681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6342753a-23e4-4c80-a024-fca146619eed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.321736 Jul 06 15:26:31.196372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 164/323] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:30 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:32.076519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:32.077115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:32.087180 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:32.087606 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:32.088962 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:32.089610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:32.214590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:32.215536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:32.224379 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:32.225229 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:32.227410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:32.227950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:32.360402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:32.373908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b06cd621-61e8-4d10-b331-ab3184575d72 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.301546 Jul 06 15:26:32.374760 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 160/324] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:32 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:32.544720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-0a986b83-b389-4dfc-bb86-9729ccfe8e43 req-85fc5be2-88b1-4e7e-9829-1f591d6ec7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeea6136-04c3-4d1f-8e59-a33186b6630f", "name": "network-vif-plugged", "status": "completed", "tag": "b7618127-2732-465e-886a-0fab54e544e7"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:32.564470 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0a986b83-b389-4dfc-bb86-9729ccfe8e43 req-85fc5be2-88b1-4e7e-9829-1f591d6ec7f0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:32.566061 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0a986b83-b389-4dfc-bb86-9729ccfe8e43 req-85fc5be2-88b1-4e7e-9829-1f591d6ec7f0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:32.589193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-0a986b83-b389-4dfc-bb86-9729ccfe8e43 req-85fc5be2-88b1-4e7e-9829-1f591d6ec7f0 service nova] Creating event network-vif-plugged:b7618127-2732-465e-886a-0fab54e544e7 for instance aeea6136-04c3-4d1f-8e59-a33186b6630f on hv-cinder-84884 Jul 06 15:26:32.610212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-0a986b83-b389-4dfc-bb86-9729ccfe8e43 req-85fc5be2-88b1-4e7e-9829-1f591d6ec7f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068383 Jul 06 15:26:32.611212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 161/325] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:26:32.646131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:32.654294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bbee812c-f10f-4f93-aa3e-76dfa3a21aac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.444852 Jul 06 15:26:32.671068 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 165/326] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:32 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:33.392972 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:33.394038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:33.402383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:33.403032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:33.404289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:33.405059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:33.411204 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:33.646580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:33.659341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-691a22bb-e908-4a3a-a6eb-50cfb44628a6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.268105 Jul 06 15:26:33.669608 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 162/327] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:33 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:33.674927 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:33.676103 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=8 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:33.682853 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:33.685262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:33.694760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:33.695731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:33.696751 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:33.697819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:34.440684 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:34.476890 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0a05d8ac-9776-47f0-b986-291c24ef6bd4 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.803842 Jul 06 15:26:34.478179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 166/328] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:33 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:34.677748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:34.678994 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:34.690907 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35738679-2ff5-4aff-b60e-90b17b36020b", "device": "/dev/sdb"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:34.692579 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:34.717739 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:34.724575 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:34.725210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:34.725685 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:34.727874 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:34.729060 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:34.730507 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:34.730900 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:35.046084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:35.055887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4ee08544-96dd-43ca-997c-10bc24442690 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1313 microversion: 2.1 time: 0.382505 Jul 06 15:26:35.065483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 163/329] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:34 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:35.495058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:35.496306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:35.507152 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:35.508415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:35.509006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:35.510955 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:35.532025 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-71a60f61-6548-4d45-85b5-90974451271d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "POST /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848166 Jul 06 15:26:35.538574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 167/330] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:26:34 2022] POST /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:35.748601 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:35.765239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-125a14ad-3ca6-4e8e-8a7e-832aec2fc2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.273158 Jul 06 15:26:35.776700 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 164/331] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:35 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:36.082186 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:36.083559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:36.098976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:36.102363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:36.104866 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:36.105578 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:36.453491 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:36.464163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0b623515-0997-49bc-8ebb-43d9c8bd86f0 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1496 microversion: 2.1 time: 0.387497 Jul 06 15:26:36.464707 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 168/332] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:36 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1496 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:36.794319 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:36.795681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:36.809112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:36.815037 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:36.815753 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:36.820090 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:36.822202 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:37.308069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:37.309242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:37.322827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:37.323523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:37.326746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:37.327422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:37.332038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:37.341138 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dc3fc0fe-edca-4d0c-bf50-cb70b5bcdcc5 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.551322 Jul 06 15:26:37.343660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 165/333] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:36 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:37.392135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:26:37.501239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-26da9c59-e9d9-4984-bcb3-b4070b78dd58 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 204 len: 0 microversion: 2.1 time: 0.197809 Jul 06 15:26:37.501834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 169/334] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:26:37 2022] DELETE /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:26:37.510245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:37.510860 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:37.520874 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:37.521346 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:37.522099 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:37.523819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:37.797418 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:37.812901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9af5b9f7-04d3-4e92-a922-8612c2caf113 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1502 microversion: 2.1 time: 0.306008 Jul 06 15:26:37.814720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 166/335] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:37 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1502 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:38.360542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:38.361873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:38.369775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:38.370443 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:38.371456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:38.372206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:38.565489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:38.584366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-58b37d80-6bb8-41ea-bd79-2dc7341366e2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.228061 Jul 06 15:26:38.586676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 170/336] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:38 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:38.831558 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:38.832584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:38.840557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:38.841228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:38.842441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:38.843975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:39.141566 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:39.173269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0d5d380c-f074-45f2-a8a1-e75e386270b6 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1502 microversion: 2.1 time: 0.336087 Jul 06 15:26:39.173793 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 167/337] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:38 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:39.602655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:39.603681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:39.617222 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:39.619614 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:39.620738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:39.623197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:39.819200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:39.828022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ae5a0037-fdbd-4ee6-9d6d-cedaba6ca896 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.229905 Jul 06 15:26:39.829217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 171/338] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:39 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:40.099063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-4ef2561a-054c-4404-8692-bae3dfe6918f req-138321a6-70f6-4a90-82e1-c3813c5076f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeea6136-04c3-4d1f-8e59-a33186b6630f", "name": "network-vif-deleted", "tag": "b7618127-2732-465e-886a-0fab54e544e7"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:40.123114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-4ef2561a-054c-4404-8692-bae3dfe6918f req-138321a6-70f6-4a90-82e1-c3813c5076f3 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:40.124251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-4ef2561a-054c-4404-8692-bae3dfe6918f req-138321a6-70f6-4a90-82e1-c3813c5076f3 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:40.176892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-4ef2561a-054c-4404-8692-bae3dfe6918f req-138321a6-70f6-4a90-82e1-c3813c5076f3 service nova] Creating event network-vif-deleted:b7618127-2732-465e-886a-0fab54e544e7 for instance aeea6136-04c3-4d1f-8e59-a33186b6630f on hv-cinder-84884 Jul 06 15:26:40.190118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:40.190737 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:40.197321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:40.197705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:40.198478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:40.198909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:40.203725 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-4ef2561a-054c-4404-8692-bae3dfe6918f req-138321a6-70f6-4a90-82e1-c3813c5076f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113889 Jul 06 15:26:40.204434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 168/339] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:40.213903 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:40.362749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857d941f699143ecbf25d842fb1f9ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee14fb4cfead402ab57d78792f303b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:40.389900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-037d7db9-cdcb-489d-8458-10b92ae4d8e5 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 200 len: 1298 microversion: 2.1 time: 0.196936 Jul 06 15:26:40.391116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 172/340] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:40 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:40.846738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:40.847469 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:40.857736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:40.860130 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:40.861179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:40.862644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:41.057979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:41.087689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a8106b1e-c1d9-4136-8f8f-3d5419c5ae91 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.245866 Jul 06 15:26:41.088756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 169/341] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:40 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:41.412059 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:41.412731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] [instance: aeea6136-04c3-4d1f-8e59-a33186b6630f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:41.426994 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:41.427735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:41.440168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:41.443935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:41.474829 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] HTTP exception thrown: Instance aeea6136-04c3-4d1f-8e59-a33186b6630f could not be found. Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Request method failure captured: Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f HTTP/1.1 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixal-tDXAVcp-fd4cAJoxl2ZOyI8EiYJ0xA_gB_r7MwNU_ytcAx6BXoBZNrSM00h8ylf3GfY_NhO0lR4qL1NMqP8oSYMkA0YrcE3-TW8P1CC17gmAzHKFjHO7TzLBI3ZX99gtCUE8ehOPlhrqXu6zezOfMUFWbRtl5H-aOzRlljUAq28 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: ee14fb4cfead402ab57d78792f303b48 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesActionsTest-974457274 Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:26:41.479141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee14fb4cfead402ab57d78792f303b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesActionsTest-974457274 Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: ee14fb4cfead402ab57d78792f303b48 Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesActionsTest-974457274 Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesActionsTest-974457274-project Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 857d941f699143ecbf25d842fb1f9ff8 Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesActionsTest-974457274-project Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance aeea6136-04c3-4d1f-8e59-a33186b6630f could not be found. Jul 06 15:26:41.480695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'aeea6136-04c3-4d1f-8e59-a33186b6630f'} Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeea6136-04c3-4d1f-8e59-a33186b6630f could not be found. Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:26:41.481475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeea6136-04c3-4d1f-8e59-a33186b6630f could not be found. Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeea6136-04c3-4d1f-8e59-a33186b6630f could not be found. Jul 06 15:26:41.482661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:26:41.486677 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] Returning 404 to user: Instance aeea6136-04c3-4d1f-8e59-a33186b6630f could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:26:41.488900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-baab8d03-fcc7-4ed9-ac98-624d8c099590 tempest-VolumesActionsTest-974457274 tempest-VolumesActionsTest-974457274-project] 10.222.0.46 "GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f" status: 404 len: 111 microversion: 2.1 time: 0.082559 Jul 06 15:26:41.497699 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 173/342] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:41 2022] GET /compute/v2.1/servers/aeea6136-04c3-4d1f-8e59-a33186b6630f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:26:42.106450 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:42.108000 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:42.130163 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:42.132123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:42.134229 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:42.136919 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:42.279443 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:42.279935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:42.296109 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:42.296600 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:42.297377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:42.297806 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:42.393704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4791bd40-42ee-416e-9bc4-43164cf9ac3e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/ips" status: 200 len: 146 microversion: 2.1 time: 0.118873 Jul 06 15:26:42.394277 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 174/343] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:26:42 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/ips => generated 146 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:42.616077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:42.629975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-21e04848-e41b-4039-bba6-e12753a34a27 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.528456 Jul 06 15:26:42.632799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 170/344] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:42 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:43.651767 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:43.652379 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:43.666131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:43.666593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:43.667421 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:43.673738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:43.922939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:43.939645 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-19538101-4190-4781-8715-5802287c346f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.293783 Jul 06 15:26:43.940656 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 175/345] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:43 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:44.963170 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:44.966030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:44.985213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:44.986341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:44.988042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:44.988758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:45.310058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:45.325959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5e228a7e-eea2-456d-baa7-22c5b2db9dca tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.371000 Jul 06 15:26:45.337510 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 171/346] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:44 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:46.346098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:46.346702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:46.357050 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:46.357753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:46.360822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:46.362735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:46.536836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:46.545121 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9aadd736-34eb-4f84-9746-0e6e1b7eca4c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.204261 Jul 06 15:26:46.562350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 176/347] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:46 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:47.578339 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:47.579730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:47.589576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:47.590037 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:47.590812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:47.591264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:47.732790 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:47.740853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a567e7d6-ea3c-4f9c-868c-f7ead9f209cc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.166492 Jul 06 15:26:47.741545 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 172/348] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:47 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:48.000258 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:48.001323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:48.016864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:48.017567 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:48.018501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:48.018965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:48.043043 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-71b42168-fa4a-42ae-99e4-da5a2e4d0094 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/ips" status: 200 len: 150 microversion: 2.1 time: 0.049775 Jul 06 15:26:48.049640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 177/349] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:26:47 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:48.770318 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:48.771033 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:48.778066 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:48.778606 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:48.779471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:48.779972 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:48.924697 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:48.936537 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c107dda9-49e7-4e74-a551-1f103cc23f28 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.170148 Jul 06 15:26:48.943345 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 173/350] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:48 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:49.954838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:49.955866 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:49.962708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:49.963157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:49.963970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:49.964405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:50.151018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:50.159995 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a632a237-2c85-4920-8c94-affe933dce17 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.209456 Jul 06 15:26:50.160996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f839319d-2aff-4bb8-a297-fbac50d30cd2"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:50.161589 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 178/351] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:49 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:50.163148 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:50.169436 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:50.170090 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:50.171021 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:50.171694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:50.639937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7624e95e-0f14-4fac-bac5-f752894d60b5"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:50.641344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:50.651957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:50.652409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:50.653191 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:50.653649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:50.720366 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e93a3373-8c7d-47dd-8687-d999efe0873b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563243 Jul 06 15:26:50.725067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 174/352] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:26:50 2022] POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:51.071504 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2f1df19f-1a8f-4641-a1e6-0821ae1dc9c0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436443 Jul 06 15:26:51.073216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 179/353] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:26:50 2022] POST /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:26:51.179038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:51.179763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:51.188791 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:51.189238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:51.190022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:51.190452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:51.407760 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:51.415944 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0614fa1c-ff09-48fb-a03a-b6e7260cbd84 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.241518 Jul 06 15:26:51.419305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 175/354] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:51 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:52.432768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:52.433468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:52.439935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:52.440388 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:52.441381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:52.441823 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:52.488157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2b5af94d-e480-4289-b9d6-6606f6fa506e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Action: 'create', calling method: .version_select at 0x7f449c5e4dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2104323971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLuWVZP3pC2Dc+DV4jZBEEJqNcH3KOREsR43PlDBcjPgVTXrDQrIQ6o7QoJidEhYhuJIBASA7VFzC8E0LJgIaULsaGeHZRdpgDnLqmzkc5NfRRVqm0Subgad2uZAzyRwA=="}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:52.502233 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-2b5af94d-e480-4289-b9d6-6606f6fa506e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Getting quotas for project 0805ca8c35a34d0dbf0f1e7ac459c517. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:26:52.507543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-2b5af94d-e480-4289-b9d6-6606f6fa506e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Getting quotas for user b57356f7b4e748438b89d69663bb99ee and project 0805ca8c35a34d0dbf0f1e7ac459c517. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:26:52.532087 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2b5af94d-e480-4289-b9d6-6606f6fa506e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048731 Jul 06 15:26:52.542637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 176/355] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:26:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:26:52.588386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:52.596522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f1353e48-910c-4456-b97c-e0ffbeee3e89 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.168391 Jul 06 15:26:52.599248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 180/356] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:52 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:26:52.644477 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1702751397", "imageRef": "525935ec-c496-422c-a533-ded4008636c7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2104323971", "networks": [{"uuid": "c6ecbf13-cdde-4eb1-a04c-6350b37f96a3"}]}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:26:53.614422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:53.615162 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:53.618034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:53.624001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:53.625854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:53.626695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:53.627289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:53.769731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:53.778320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b11be2f0-2a64-4793-b7e3-24be9660173f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.168491 Jul 06 15:26:53.778882 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 181/357] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:53 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:54.797384 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:54.797980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:54.804523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:54.804969 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:54.805733 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:54.806183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:54.981298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:54.993580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b19ff9b-baf5-45a0-b566-133e7de1d901 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.200611 Jul 06 15:26:54.994252 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 182/358] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:54 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:56.010623 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:56.011273 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:56.017792 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:56.018239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:56.018998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:56.019459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:56.149418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:56.157896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-609d7ab0-de8d-4f1d-9a96-46c8967064ec tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.151136 Jul 06 15:26:56.158458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 183/359] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:56 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:57.174047 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:57.174649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:57.181003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:57.181447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:57.182197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:57.182627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:57.310993 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:57.319506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c51e22e9-b118-4ff7-b88b-56a5d52a2b20 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.149604 Jul 06 15:26:57.320015 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 184/360] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:57 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:58.337407 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:58.338163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:58.346364 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:58.346988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:58.347915 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:58.348350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:58.498616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:58.513631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d557e9e9-5e6a-4549-a4d7-93994b5e21c9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.180481 Jul 06 15:26:58.514266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 185/361] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:58 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:26:59.531570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:26:59.532211 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:26:59.538707 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:59.539211 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:59.540103 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:26:59.540540 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:26:59.694099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:26:59.702704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ebb8dca6-882a-4be7-b992-29c34a82718e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.175364 Jul 06 15:26:59.703510 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 186/362] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:26:59 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:00.719644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:00.721741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:00.728639 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:00.729189 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:00.730015 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:00.730509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:00.873258 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:00.881385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0c2ede2b-8a61-4505-a66d-9928e3e08d8c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.165549 Jul 06 15:27:00.881961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 187/363] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:00 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:00.886612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2a5cc2bf-94da-42e5-9017-b515f63607fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:00.892896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2a5cc2bf-94da-42e5-9017-b515f63607fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:00.893349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2a5cc2bf-94da-42e5-9017-b515f63607fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:00.955950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2a5cc2bf-94da-42e5-9017-b515f63607fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Going to try to stop instance {{(pid=117619) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 06 15:27:00.960352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:01.000422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2a5cc2bf-94da-42e5-9017-b515f63607fe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action" status: 202 len: 0 microversion: 2.1 time: 0.117261 Jul 06 15:27:01.001120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 188/364] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:27:00 2022] POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:27:01.013442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:01.014050 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:01.021485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:01.022475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:01.023349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:01.023786 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:01.168775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:01.177943 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2daa04be-75b7-4960-a76a-739f1799b662 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.171646 Jul 06 15:27:01.178785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 189/365] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:01 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:01.425316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:01.899473 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:01.901140 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:01.909217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:01.909669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:01.910425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:01.910879 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:02.044162 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:02.051693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6184e0a8-a889-47ee-ad0d-8a5cada15123 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.157024 Jul 06 15:27:02.052263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 190/366] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:01 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:02.197474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:02.198082 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:02.204030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:02.204480 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:02.205881 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:02.206317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:02.330658 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:02.338609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-38a3b828-7db2-471d-b970-446ea0dc639d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.145021 Jul 06 15:27:02.339178 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 191/367] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:02 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:02.514169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=4 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:02.653648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:03.069032 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:03.069725 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:03.077490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:03.077901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:03.078918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:03.079311 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:03.224449 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:03.232194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-303523fb-5ce9-4652-b438-a99ee6e43566 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.167418 Jul 06 15:27:03.233043 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 192/368] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:03 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:03.356158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:03.356832 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:03.364327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:03.364918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:03.365775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:03.366681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:03.505925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:03.516957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1696e4b0-2b19-4bcf-b6fe-005b3bb6872f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.164926 Jul 06 15:27:03.518582 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 193/369] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:03 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:04.249210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:04.249980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:04.257902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:04.258479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:04.259486 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:04.259923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:04.394841 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:04.403076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ea4669d3-2d83-44bc-b285-7bc8da46bd6e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.157756 Jul 06 15:27:04.403727 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 194/370] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:04 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:04.535729 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:04.536335 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:04.542799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:04.543466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:04.544240 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:04.544690 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:04.688325 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:04.696418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-41b73dcf-2390-43a3-86ef-a2624233f6b1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.164534 Jul 06 15:27:04.696977 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 195/371] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:04 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:04.970920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:04.971456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:04.978445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:04.978901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:04.979778 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:04.980223 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:05.168270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lazy-loading 'services' on Instance uuid dbc61511-ad97-49b6-8127-d567909b6ebb {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:27:05.319021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ab924de3-df87-4afe-951f-893110620939 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb/os-volume_attachments/35738679-2ff5-4aff-b60e-90b17b36020b" status: 202 len: 0 microversion: 2.1 time: 0.353092 Jul 06 15:27:05.320203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 196/372] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:27:04 2022] DELETE /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb/os-volume_attachments/35738679-2ff5-4aff-b60e-90b17b36020b => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:27:05.426391 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:05.427160 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:05.441775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:05.442247 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:05.448139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:05.449029 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:05.638006 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:05.646697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4abfe0f3-3ea0-40e6-ae04-4939e1312739 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.228739 Jul 06 15:27:05.647479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 197/373] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:05 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:05.714043 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:05.714652 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:05.721334 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:05.721785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:05.722538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:05.722980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:05.865365 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:05.873308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-11489a91-4cd4-48ad-8dec-2f3a30e2e80f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.163271 Jul 06 15:27:05.873896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 198/374] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:05 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:06.666052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:06.666052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:06.674861 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:06.675797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:06.677531 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:06.678266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:06.835834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:06.843565 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-37a9f1de-bd33-48b1-b6fc-9a26f12278f1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.183096 Jul 06 15:27:06.855272 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 199/375] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:06 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:06.891715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:06.893755 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:06.900323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:06.900999 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:06.901911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:06.902476 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:07.080880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:07.091033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a4241a3b-0be2-49d3-a204-2a5b9dee7038 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.203871 Jul 06 15:27:07.091822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 200/376] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:06 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:07.309629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-62c0f063-42a0-4580-9d5f-557a072e7367 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: .version_select at 0x7f449d6291f0>, body: {"keypair": {"name": "tempest-keypair-667302855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSU71vyKPiGEOz05ARrfGJeVP0TtCserd9FgKp6WJgsPUZo/gvqopOW2YTlxhoR5hR3IQlTXUvRiEzY1IX8tcGydVakmWkNTKOKOvHwEsQkk1zL6wgs0xluSwjK/7XuA=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:07.330483 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-62c0f063-42a0-4580-9d5f-557a072e7367 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:27:07.336333 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-62c0f063-42a0-4580-9d5f-557a072e7367 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:27:07.401694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-62c0f063-42a0-4580-9d5f-557a072e7367 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095783 Jul 06 15:27:07.402716 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 201/377] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:27:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:07.862292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:07.864001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:07.875886 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:07.878410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:07.879400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:07.880491 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.112394 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:08.126232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b0db9f3a-7f99-4065-a1a7-bc38e98d2780 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.266478 Jul 06 15:27:08.127945 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 202/378] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:07 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:08.132659 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:08.133257 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:08.139766 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:08.140456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.141431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:08.142113 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.327238 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:08.338177 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7b9175a7-854c-4d97-bcaf-f618299eface tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.209083 Jul 06 15:27:08.339693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 203/379] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:08 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:08.674592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:08.675157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:08.683184 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:08.684231 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.685206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:08.685700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.718505 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:27:08.724248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:08.838791 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-83126315-9e5f-40c8-a82b-d31c54c5966d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 204 len: 0 microversion: 2.1 time: 0.169470 Jul 06 15:27:08.845294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 204/380] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:27:08 2022] DELETE /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:27:08.870330 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:08.873699 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:08.893713 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:08.894620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.896297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:08.897021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:08.898123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] validate_networks() for [('c6ecbf13-cdde-4eb1-a04c-6350b37f96a3', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:27:09.058583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:09.066801 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ca02769-8efe-4145-a7da-08e4baa9e711 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1513 microversion: 2.1 time: 0.214377 Jul 06 15:27:09.067924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 205/381] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:08 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:09.145543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:09.146680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:09.159644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:09.162581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:09.164186 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:09.165064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:09.380415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:09.389150 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8316de81-b610-4378-8c65-76f333a92749 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.249220 Jul 06 15:27:09.401159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 206/382] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:09 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:09.416716 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:09.420504 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:09.446164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:09.447989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:09.448980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:09.449571 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:09.560687 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:27:09.561107 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:27:09.561745 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:27:09.562376 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:27:09.562788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:27:09.575719 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:09.576317 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:09.577288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:09.577878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:09.597692 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Getting quotas for project 0805ca8c35a34d0dbf0f1e7ac459c517. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:27:09.602067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Getting quotas for user b57356f7b4e748438b89d69663bb99ee and project 0805ca8c35a34d0dbf0f1e7ac459c517. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:27:09.616588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:27:09.620506 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='525935ec-c496-422c-a533-ded4008636c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:27:09.678458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dc0bf077-c8c4-43b8-84f3-a42e4878f937 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.037777 Jul 06 15:27:09.679525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 177/383] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:26:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 17040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 15:27:09.685253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1871802316", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5"}], "security_groups": [{"name": "tempest-securitygroup--499450787"}], "key_name": "tempest-keypair-667302855", "user_data": "}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:09.732181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:09.741686 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f2b12b4a-2298-403f-acd2-816634157ba0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.339077 Jul 06 15:27:09.747459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 207/384] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:09 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:09.752881 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7caf245d-e54b-4abc-93b9-0b26275d9cf7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:09.754535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7caf245d-e54b-4abc-93b9-0b26275d9cf7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:09.865783 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7caf245d-e54b-4abc-93b9-0b26275d9cf7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:09.880626 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7caf245d-e54b-4abc-93b9-0b26275d9cf7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1259 microversion: 2.1 time: 0.131887 Jul 06 15:27:09.883707 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 208/385] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:09 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1259 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:09.927932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] validate_networks() for [('a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:27:10.086993 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:10.087913 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:10.102717 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.103169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.105387 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.105793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.267679 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:10.277104 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5a2e02dc-60c1-49f2-b3f5-eb530df1ac95 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1513 microversion: 2.1 time: 0.195794 Jul 06 15:27:10.277924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 209/386] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:10 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:10.412662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:10.413276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:10.422805 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.423880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.435812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:27:10.436646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:27:10.437487 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:27:10.437820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.438283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.438587 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:27:10.439241 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:27:10.450616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.451060 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.451876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.452304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.468967 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:27:10.473429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:27:10.484512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:27:10.487273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:27:10.536887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-238469d5-1f57-4ec3-a6d4-b23ac8e3eb7b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.855973 Jul 06 15:27:10.545492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 178/387] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:27:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:27:10.553994 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-36aea47d-72fe-48b5-aa9f-52cfbcfd4fd2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:10.554956 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-36aea47d-72fe-48b5-aa9f-52cfbcfd4fd2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:10.622016 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:10.633775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-03e33089-0a5c-423a-9f31-aead02ff83ee tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.227174 Jul 06 15:27:10.644493 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 210/388] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:10 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:10.700650 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-36aea47d-72fe-48b5-aa9f-52cfbcfd4fd2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:10.709749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-36aea47d-72fe-48b5-aa9f-52cfbcfd4fd2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1241 microversion: 2.1 time: 0.162748 Jul 06 15:27:10.710391 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 179/389] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:10 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:10.764497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:10.765434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:10.773926 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.774491 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.775507 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.776264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.902202 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:10.903273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:10.914047 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.915890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.917931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:10.920547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:10.992757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:11.004843 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-414d9b62-c2bf-463e-9b2c-7e7caf02840d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.244337 Jul 06 15:27:11.005666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 211/390] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:10 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:11.046205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:11.054697 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-244799b1-ea12-4aa3-baf9-7d7218457e68 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1255 microversion: 2.1 time: 0.156313 Jul 06 15:27:11.055762 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 180/391] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:10 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1255 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:11.295431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:11.296131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:11.302944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:11.303469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:11.304314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:11.304929 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:11.446021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:11.455242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-baa43dc8-9f6e-449d-b8bd-777b8c13e81d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1513 microversion: 2.1 time: 0.163753 Jul 06 15:27:11.455975 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 212/392] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:11 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:11.651572 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:11.652119 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:11.659742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:11.660192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:11.660963 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:11.661410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:11.726719 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:11.727521 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:11.733858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:11.734389 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:11.735587 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:11.736077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:11.806334 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:11.808614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:11.815683 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-606469b2-42ec-4f40-9fd9-a2795116c7bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1245 microversion: 2.1 time: 0.092771 Jul 06 15:27:11.818057 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9d7c32b4-43d8-4a67-8ff3-23424e166260 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.170518 Jul 06 15:27:11.818816 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 181/393] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:11 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:11.825232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 213/394] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:11 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:12.022250 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:12.022856 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:12.029056 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.029497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.030507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.031812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.085906 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:12.087706 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:12.109149 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.112269 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.116142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.116944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.291407 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:12.305695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3644e457-20f9-4544-b440-17b745baa449 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1255 microversion: 2.1 time: 0.236294 Jul 06 15:27:12.317828 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 214/395] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:12 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1255 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:12.455957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:12.465921 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-82693402-c93d-40f1-9c9d-554a23f5b8ad tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.447433 Jul 06 15:27:12.475088 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 182/396] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:12 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:12.475321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:12.475321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:12.479811 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.480253 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.481022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.481448 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.635628 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:12.646917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9fe6aab7-7888-491c-9ea2-a5cbd680f97a tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1513 microversion: 2.1 time: 0.178011 Jul 06 15:27:12.685624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 215/397] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:12 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:12.835693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:12.836216 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:12.837097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:12.839344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:12.847721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.848610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.849865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.850489 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.880030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.880878 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.881922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:12.903036 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:12.990390 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:13.002080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c37f27cc-e868-4dc1-a764-c75fb4055c97 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1293 microversion: 2.1 time: 0.171821 Jul 06 15:27:13.002906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 183/398] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:12 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:13.060780 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-7d78b369-aaf4-409e-9608-0f31f4a9192d req-86253eec-6f2c-47a2-8df3-4020b59499f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc61511-ad97-49b6-8127-d567909b6ebb", "name": "network-vif-deleted", "tag": "74bf4e8a-6917-4bfa-85fd-a39eecbb576e"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:13.073436 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-7d78b369-aaf4-409e-9608-0f31f4a9192d req-86253eec-6f2c-47a2-8df3-4020b59499f7 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.074604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-7d78b369-aaf4-409e-9608-0f31f4a9192d req-86253eec-6f2c-47a2-8df3-4020b59499f7 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.100080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-7d78b369-aaf4-409e-9608-0f31f4a9192d req-86253eec-6f2c-47a2-8df3-4020b59499f7 service nova] Creating event network-vif-deleted:74bf4e8a-6917-4bfa-85fd-a39eecbb576e for instance dbc61511-ad97-49b6-8127-d567909b6ebb on hv-cinder-84884 Jul 06 15:27:13.106877 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-7d78b369-aaf4-409e-9608-0f31f4a9192d req-86253eec-6f2c-47a2-8df3-4020b59499f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049838 Jul 06 15:27:13.107942 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 184/399] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:13.149777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:13.158448 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6cdc0c68-935c-467b-918d-4cd3492e7b21 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.328259 Jul 06 15:27:13.159254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 216/400] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:12 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:13.325943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:13.326940 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:13.340742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.341192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.344535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.345576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.484529 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:13.489383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:13.490214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:13.495779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b30115df-42d9-4f8e-b0bf-b68225b00b59 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1319 microversion: 2.1 time: 0.174197 Jul 06 15:27:13.496387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 185/401] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:13 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:13.499631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.500749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.502438 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.503036 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.655091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:13.663708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0c0bef85-65a1-4e92-b686-dd99106f7e66 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.185530 Jul 06 15:27:13.664287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 217/402] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:13 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:13.691871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:13.692474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:13.699366 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.700050 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.700811 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:13.701245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:13.784180 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:13.798333 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-36e22917-bd99-48a3-b2c5-36407c819c52 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1304 microversion: 2.1 time: 0.110625 Jul 06 15:27:13.799721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 186/403] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:13 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:14.023919 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:14.025209 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:14.046809 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.047401 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.048904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.049429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.141229 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:14.150126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c3d8f080-42dc-4401-971e-6dc9ad83644b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1311 microversion: 2.1 time: 0.133375 Jul 06 15:27:14.161631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 218/404] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:14 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:14.175738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:14.176578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:14.183006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.183437 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.184387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.184815 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.439663 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:14.447551 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-95eb9ff4-6294-4ddf-8400-e265004a389f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.276482 Jul 06 15:27:14.448180 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 187/405] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:14 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:14.514468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:14.515734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:14.524011 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.524818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.526035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.526743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.682204 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:14.683209 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:14.697720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.698175 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.700349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.700847 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.842360 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:14.851789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2f741e52-e4ab-429f-a375-e0765ddfac3b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.342062 Jul 06 15:27:14.862354 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 219/406] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:14 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:14.872582 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:14.873690 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:14.880054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.880678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.881620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.882193 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.932250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:14.932700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:14.933149 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lazy-loading 'fault' on Instance uuid dbc61511-ad97-49b6-8127-d567909b6ebb {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:27:14.933636 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:14.939386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:14.943774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-93ffa583-68b2-429b-9b15-15e7377ed114 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.265773 Jul 06 15:27:14.954636 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 188/407] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:14 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:14.997201 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:15.004981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0e4f9fc7-9e62-43ff-b279-224c71d4f0c9 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 200 len: 1309 microversion: 2.1 time: 0.141515 Jul 06 15:27:15.014344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 220/408] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:14 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:15.171413 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:15.172478 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:15.187428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.187879 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.190111 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.190897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.328571 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:15.341894 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-df504180-5ef8-4334-b6a6-08adc88957ee tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1299 microversion: 2.1 time: 0.173328 Jul 06 15:27:15.353823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 189/409] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:15 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:15.464655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:15.465283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:15.467547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:15.475527 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.476439 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.477430 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.478055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.634594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:15.650386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3c973be8-303a-4837-b48e-a01db2018213 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1502 microversion: 2.1 time: 0.189355 Jul 06 15:27:15.656528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 221/410] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:15 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:15.675707 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93cdc3b5-a715-4569-a4da-2bd29e921db7"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:15.677730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:15.690702 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.691819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.693708 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.694446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.729485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] HTTP exception thrown: Cannot 'attach_volume' instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 while it is in vm_state rescued Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Request method failure captured: Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/os-volume_attachments HTTP/1.1 Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 74 Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalBpvBuBv4BaUaE2m0dDEyN5geTRYSJ2dfrrriheFGSIcjVDc3BdnqUpo-etU0q4BL1qGBxJ3juKDk0BwvOUgiHlbEZn_ean40sW0BMwimYVmDIedVne_OtGoTj_WQXnyPNne-4hDkByV9vivPwdae00JsdoOao1E5IP7WdlFuzSRw Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:27:15.731291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 46896be59b73481287235aac3d630f4e Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {"volumeAttachment": {"volumeId": "93cdc3b5-a715-4569-a4da-2bd29e921db7"}} Jul 06 15:27:15.732724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Cannot 'attach_volume' instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 while it is in vm_state rescued Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'server_id': 'ce440c64-f3db-4cda-8a2f-0f7e00f36b30', 'body': {'volumeAttachment': {'volumeId': '93cdc3b5-a715-4569-a4da-2bd29e921db7'}}} Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:27:15.733619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 while it is in vm_state rescued Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:27:15.734796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 while it is in vm_state rescued Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Returning 409 to user: Cannot 'attach_volume' instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 while it is in vm_state rescued {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1d9542ab-5d0a-43b8-bda6-7f6ac9b2e0be tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063994 Jul 06 15:27:15.736667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 190/411] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:27:15 2022] POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 06 15:27:15.748348 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:15.753255 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:15.764654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.765488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.767968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.768748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.877216 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:15.877832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:15.887131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.887581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.888351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.888784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.916803 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d27a8057-8002-4978-89b6-d3c9f9b500b7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/action" status: 202 len: 0 microversion: 2.1 time: 0.175385 Jul 06 15:27:15.925265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 222/412] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:27:15 2022] POST /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:27:15.942461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:15.943725 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:15.989734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.990472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:15.991439 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:15.992285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.224125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:16.236443 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bd8f51e5-ecd7-49ea-b52d-a39311137aa6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.307647 Jul 06 15:27:16.237621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 223/413] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:15 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:16.248956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:16.248956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:16.259292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:16.259292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.259292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:16.262111 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.529050 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:16.541635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0a273030-559d-4ce5-b775-33a456110429 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.301421 Jul 06 15:27:16.542982 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 224/414] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:16 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:16.551528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:16.552434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: dbc61511-ad97-49b6-8127-d567909b6ebb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:16.559756 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:16.560212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.560989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:16.561591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.575774 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] HTTP exception thrown: Instance dbc61511-ad97-49b6-8127-d567909b6ebb could not be found. Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Request method failure captured: Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb HTTP/1.1 Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixal4CG6M7OaoHkXr2TipVLLEBN5suZpryqioRN5FWeOD4sMG5YVq8loagDjx41CSVQcl2eAuLP2lwNLH-JuXHe-GGulS_CoCAIFEcQGdfOy_OhO3TAb78gqfr3yiNhlokIvyRwOD3rpg0ZW_LWVTm_nAv3v1HBNcIQtm6TDDX1IFuOs Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: a75a2d018dff40bfb9b5bd72a678826c Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesSnapshotTestJSON-376915781 Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:27:16.578144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesSnapshotTestJSON-376915781 Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: a75a2d018dff40bfb9b5bd72a678826c Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-376915781 Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesSnapshotTestJSON-376915781-project Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 74581e9c5b27401686b40b2312a6f2fb Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesSnapshotTestJSON-376915781-project Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance dbc61511-ad97-49b6-8127-d567909b6ebb could not be found. Jul 06 15:27:16.579747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'dbc61511-ad97-49b6-8127-d567909b6ebb'} Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc61511-ad97-49b6-8127-d567909b6ebb could not be found. Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:27:16.580577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc61511-ad97-49b6-8127-d567909b6ebb could not be found. Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc61511-ad97-49b6-8127-d567909b6ebb could not be found. Jul 06 15:27:16.581790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:27:16.583712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Returning 404 to user: Instance dbc61511-ad97-49b6-8127-d567909b6ebb could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:27:16.584994 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0fef6da8-3689-48c3-b1ab-e6d11ccea032 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb" status: 404 len: 111 microversion: 2.1 time: 0.040796 Jul 06 15:27:16.586039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 225/415] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:16 2022] GET /compute/v2.1/servers/dbc61511-ad97-49b6-8127-d567909b6ebb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:27:16.597466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:16.598458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:16.605443 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:16.606221 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.607407 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:16.608064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:16.706076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:16.713989 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:16.768576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6e95881c-adbc-4319-aae7-eda9581441e4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1299 microversion: 2.1 time: 0.178477 Jul 06 15:27:16.769191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5718c790-4cf4-4e8d-8b7d-db198ea45d93 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.902090 Jul 06 15:27:16.772488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 226/416] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:16 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:16.797694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 191/417] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:15 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:17.260955 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:17.261570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:17.271530 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.272257 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.275735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.277673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.299319 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-005070fb-0061-43da-b836-44798a133c4e req-4703dba0-928a-4ef1-88f1-67bc162f26b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:17.325040 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-005070fb-0061-43da-b836-44798a133c4e req-4703dba0-928a-4ef1-88f1-67bc162f26b2 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.326200 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-005070fb-0061-43da-b836-44798a133c4e req-4703dba0-928a-4ef1-88f1-67bc162f26b2 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.347822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-005070fb-0061-43da-b836-44798a133c4e req-4703dba0-928a-4ef1-88f1-67bc162f26b2 service nova] Creating event network-changed:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:27:17.354574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-005070fb-0061-43da-b836-44798a133c4e req-4703dba0-928a-4ef1-88f1-67bc162f26b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059568 Jul 06 15:27:17.356118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 192/418] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:17.512621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:17.526116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b6ee5e3-063d-4603-848e-3dc770eeaf16 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.271919 Jul 06 15:27:17.526700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 227/419] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:17 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:17.561655 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:17.564383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:17.571364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.571815 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.572861 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.573296 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.721220 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:17.730012 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-633b433c-dd33-44d6-8e0a-ae0a72ac1a91 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.173103 Jul 06 15:27:17.730552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 193/420] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:17 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:17.796410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:17.796940 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:17.803486 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.804324 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.805290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.805451 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:17.806024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.806399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:17.813110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.814340 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:17.815108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:17.815578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:18.059638 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:18.068754 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-56cecd32-ff81-4be6-b103-1e07485530d4 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.267055 Jul 06 15:27:18.069326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 194/421] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:17 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:18.070013 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:18.086200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e9aaf606-8e1a-4da0-9b91-eed5a6749790 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.293529 Jul 06 15:27:18.096138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 228/422] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:17 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:18.545696 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:18.546315 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:18.553051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:18.553506 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:18.554271 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:18.554982 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:18.704295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:18.712627 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f0aa8c29-20c6-4ec3-b0e5-be1a7f767c59 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.170812 Jul 06 15:27:18.713192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 195/423] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:18 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:18.747091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:18.747648 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:18.754454 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:18.754969 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:18.755854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:18.756352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:18.905358 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:18.914108 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d833dbac-8528-4e6c-bb62-be89cae6b8df tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.170925 Jul 06 15:27:18.914694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 229/424] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:18 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:19.086076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:19.086740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:19.093154 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.093593 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.094344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.094807 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.103884 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:19.105366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:19.112962 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.113700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.114738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.115403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.244030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:19.252509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-81e5f9f8-fa42-4a30-85a8-919c2fdcf1c3 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.170246 Jul 06 15:27:19.258264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:19.265620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 196/425] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:19 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:19.268052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2d08c06c-7e39-43f0-ade4-91d090c1dd46 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.168093 Jul 06 15:27:19.277508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 230/426] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:19 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:19.732987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:19.733715 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:19.742056 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.742797 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.744021 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.744928 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.774865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:19.931617 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:19.933371 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:19.933987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:19.936927 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:19.943973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5a42ce52-4420-4a51-ae25-90799a7e07ac tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.215580 Jul 06 15:27:19.945022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.945666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.946799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:19.949260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:19.953975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 197/427] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:19 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:20.114914 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:20.123831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1f132a1a-0787-43ce-8c69-d06f2a5b23f4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.194263 Jul 06 15:27:20.124576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 231/428] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:19 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:20.271246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:20.272673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:20.285269 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:20.286389 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:20.292764 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:20.294540 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:20.295734 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:20.296574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:20.296807 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:20.297567 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:20.298981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:20.300200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:20.460352 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=4 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:20.487013 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:20.495661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0b19d1c1-5bed-4708-a00d-233202cf06a4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.214450 Jul 06 15:27:20.496266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 232/429] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:20 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:20.704844 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=14 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:20.795462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:20.804821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2454ff8c-e935-430d-a167-89e093598b55 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.537505 Jul 06 15:27:20.805942 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 198/430] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:20 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:20.961986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:20.963329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:20.970547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:20.970986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:20.971952 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:20.972642 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.142454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:21.143238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:21.152840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.158848 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.160075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.160802 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.174877 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:21.183012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d29dff67-7564-4101-911a-fb0128d172aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.225620 Jul 06 15:27:21.192516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 233/431] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:20 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:21.489022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:21.498843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8f6caed4-f334-48ab-b54d-ee44c954f4c4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.361532 Jul 06 15:27:21.509061 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 199/432] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:21 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:21.515188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:21.515935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:21.522775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.523356 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.524413 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.525045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.811031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-a4c84ead-223e-4206-ad5d-f5be53aa07b9 req-4f92ea6b-7cdf-4006-ab17-5de587d60c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44071dc-0ea5-446e-8cf3-8509970b78a8", "tag": "8b63513d-d499-47ba-b47f-6a4a11d9be7c"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:21.820611 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-a4c84ead-223e-4206-ad5d-f5be53aa07b9 req-4f92ea6b-7cdf-4006-ab17-5de587d60c7a service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.821060 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-a4c84ead-223e-4206-ad5d-f5be53aa07b9 req-4f92ea6b-7cdf-4006-ab17-5de587d60c7a service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.829054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:21.837108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-a4c84ead-223e-4206-ad5d-f5be53aa07b9 req-4f92ea6b-7cdf-4006-ab17-5de587d60c7a service nova] Creating event network-changed:8b63513d-d499-47ba-b47f-6a4a11d9be7c for instance e44071dc-0ea5-446e-8cf3-8509970b78a8 on hv-cinder-84884 Jul 06 15:27:21.839161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f77e953e-43e6-4460-94f2-5bb76caeb2bb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.327809 Jul 06 15:27:21.843083 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-a4c84ead-223e-4206-ad5d-f5be53aa07b9 req-4f92ea6b-7cdf-4006-ab17-5de587d60c7a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038563 Jul 06 15:27:21.843709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 200/433] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:21.850208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:21.851155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:21.857249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 234/434] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:21 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:21.858263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.858901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:21.859858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:21.861001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:22.021852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:22.036051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d003c76e-74e1-4fdd-9b87-d7bd61cf1443 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.190417 Jul 06 15:27:22.044027 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 201/435] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:21 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:22.200411 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:22.201057 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:22.210747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:22.211228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:22.212031 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:22.212495 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:22.353118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:22.361264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-133c54bf-e7a6-4a51-a15f-160ec4df92fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.164677 Jul 06 15:27:22.362054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 235/436] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:22 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:22.518213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:22.518889 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:22.527365 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:22.528081 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:22.528957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:22.530070 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:22.718933 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:22.727662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-af9b2127-7a3d-44c2-9a8c-6d1b94b34adb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.214637 Jul 06 15:27:22.728251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 202/437] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:22 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:22.856664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:22.857281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:22.868941 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:22.869390 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:22.870158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:22.870725 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.017812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:23.021369 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:23.026410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-381af58f-f981-49dd-875f-f8aa72f4d9e6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.173502 Jul 06 15:27:23.037234 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 236/438] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:22 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:23.054861 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:23.055533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:23.062697 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:23.063175 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.063968 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:23.064398 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.216536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:23.226383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dad0fc05-4db4-4a6e-ba25-4aea4e161199 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.175387 Jul 06 15:27:23.236343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 203/439] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:23 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:23.380045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:23.381481 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:23.389918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:23.390560 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.391762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:23.392455 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.544937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:23.552929 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3342a20f-1711-4b57-83e9-d0807416c1ef tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.178840 Jul 06 15:27:23.553551 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 237/440] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:23 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:23.744503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:23.745125 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:23.752390 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:23.752901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.753676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:23.754130 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:23.894867 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:23.903315 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-48ae608b-8efb-420b-a193-c10e275bb5fc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1724 microversion: 2.1 time: 0.162951 Jul 06 15:27:23.903945 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 204/441] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:23 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:24.044585 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:24.045145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:24.051670 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.052110 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.052856 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.053281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.191864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:24.199103 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-aceb19dc-d7a0-474d-9ba2-8d156293f0fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.158497 Jul 06 15:27:24.199700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 238/442] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:24 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:24.244173 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:24.244811 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:24.251471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.252026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.252900 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.253359 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.382162 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:24.389445 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c5131acd-60b0-4912-a1ce-fa1951da1cd8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.149112 Jul 06 15:27:24.389995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 205/443] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:24 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:24.570228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:24.570837 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:24.577377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.577835 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.578600 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.579629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.707072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:24.714544 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0192aec0-a26f-4b4b-bfc3-8407d0440964 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.148295 Jul 06 15:27:24.715119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 239/444] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:24 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:24.920514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:24.921128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:24.928210 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.928662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:24.929491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:24.937239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.069831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:25.078034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-466ae4ae-039b-42a2-a94b-d7975651ada7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1701 microversion: 2.1 time: 0.161355 Jul 06 15:27:25.078845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 206/445] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:24 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:25.094218 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ac203c0-aab4-4b41-8767-0aa2c4f55139 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:25.100565 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ac203c0-aab4-4b41-8767-0aa2c4f55139 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.101012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ac203c0-aab4-4b41-8767-0aa2c4f55139 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.125064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ac203c0-aab4-4b41-8767-0aa2c4f55139 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Going to try to start instance {{(pid=117619) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 06 15:27:25.165636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ac203c0-aab4-4b41-8767-0aa2c4f55139 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action" status: 202 len: 0 microversion: 2.1 time: 0.075124 Jul 06 15:27:25.166225 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 240/446] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:27:25 2022] POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:27:25.174284 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:25.174931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:25.181280 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.181729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.182502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.182938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.216905 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:25.217697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:25.225204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.225995 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.226925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.227617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.342338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:25.352120 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d46e492e-8e63-4e08-96df-6f26892f0a52 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.181462 Jul 06 15:27:25.353045 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 207/447] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:25 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:25.394630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:25.402432 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b214f8e-318e-4fb2-a819-86c688ef91f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.190809 Jul 06 15:27:25.403013 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 241/448] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:25 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:25.407643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:25.408453 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:25.415382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.415495 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.416221 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.416725 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.569707 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:25.589716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3dee30e6-a845-4da0-ae15-81f9c62d64b9 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.186358 Jul 06 15:27:25.595312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 208/449] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:25 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:25.731504 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:25.733102 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:25.760016 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.760474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:25.761255 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:25.761685 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.100336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:26.112863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7925125e-2259-410d-8fe3-514aa53e3046 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.385915 Jul 06 15:27:26.115883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 242/450] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:25 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:26.369609 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:26.370920 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:26.378191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:26.378739 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.379628 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:26.380312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.419968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:26.421104 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:26.428025 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:26.428784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.429782 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:26.430440 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.566280 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:26.591015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f00ec5aa-6b59-43fe-9689-b31c13ca8694 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.225233 Jul 06 15:27:26.591640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 209/451] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:26 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:26.613508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:26.614239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:26.628886 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:26.630750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:26.631505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.632407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:26.632925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:26.654883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:26.665564 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-01384296-e3f2-4887-ba48-8ab8a60e9e5e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.248641 Jul 06 15:27:26.666699 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 243/452] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:26 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:26.831237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:26.845817 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b33a3a78-2d7c-440e-9072-255f44b37bdb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.235997 Jul 06 15:27:26.847443 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 210/453] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:26 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:27.136616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:27.137092 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:27.151764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.152220 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.153007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.153445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.399101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:27.407260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3e0ebbb0-667d-4d0a-a9df-63b8f238a1dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.278251 Jul 06 15:27:27.419750 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 244/454] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:27 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:27.611848 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:27.612701 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:27.643834 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.644518 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.645481 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.646561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.682638 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:27.683376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:27.690059 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.695729 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.696902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.697562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.850670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:27.858705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-52328344-84e1-4e1b-8066-e104cb9fbf04 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.251456 Jul 06 15:27:27.859430 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 211/455] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:27 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:27.866078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:27.867005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:27.873162 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.873602 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.874351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:27.874776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:27.886941 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:27.895647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-420e2774-263f-48ff-a182-7c54dc6666f2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.216746 Jul 06 15:27:27.897062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 245/456] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:27 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:28.023804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:28.031559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-999af101-d43e-434f-bb52-e43be49f8a2d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.168989 Jul 06 15:27:28.039678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 212/457] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:27 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:28.424768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:28.426148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:28.440971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:28.441406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:28.442353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:28.443167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:28.602641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:28.611820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-beb7552f-5133-40c8-b7c0-1084d7e1f4c2 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.191532 Jul 06 15:27:28.612403 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 246/458] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:28 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:28.876479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:28.877092 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:28.883207 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:28.883687 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:28.884448 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:28.884883 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:28.914067 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:28.915031 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:28.924654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:28.925098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:28.925862 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:28.926289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:29.045696 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:29.055097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b02b86e4-f0c0-411a-a5d3-932577fee6cf tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.182395 Jul 06 15:27:29.056357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 213/459] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:28 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:29.069475 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:29.070192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:29.077188 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:29.077774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:29.079250 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:29.079751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:29.126299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:29.135378 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8750cd8d-52b0-4a02-9a32-8282ba3641a5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.225677 Jul 06 15:27:29.136183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 247/460] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:28 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:29.271828 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:29.275356 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:29.282307 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d517ddc7-9d61-4cf1-bd79-1a37382b67bb tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.223212 Jul 06 15:27:29.283146 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 214/461] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:29 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:29.631863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:29.632967 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:29.640216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:29.640671 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:29.641985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:29.642423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:29.786351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:29.794288 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d62f367f-a772-4734-bf82-49e0a597c3e0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.169029 Jul 06 15:27:29.794883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 248/462] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:29 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:30.073605 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:30.074473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:30.082479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.083019 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.083895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.084417 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.153969 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:30.155470 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:30.162315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.163341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.164366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.165131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.236976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:30.245679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-90053b47-e005-4d49-86e4-fe714a3ecba6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.176098 Jul 06 15:27:30.247823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 215/463] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:30 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:30.299744 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:30.300458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:30.319525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.319525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.319525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.319525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.498875 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:30.508873 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-54d4e327-8798-4647-a94d-ca0e3644be8b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.213793 Jul 06 15:27:30.510042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 216/464] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:30 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:30.574220 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:30.583180 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-25d880f4-d918-4a26-a0e2-265ef8eae54a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.434034 Jul 06 15:27:30.583825 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 249/465] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:30 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:30.812699 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:30.813365 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:30.820064 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.820512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:30.822072 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:30.822803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.094190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1090025022", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "networks": [{"uuid": "29faeaee-d3c7-4625-83ea-4cacc91dc1a5"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:31.187413 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] validate_networks() for [('29faeaee-d3c7-4625-83ea-4cacc91dc1a5', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:27:31.545041 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:31.556121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-882cff49-87cb-44e1-a95a-8428f4fdfb07 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.747954 Jul 06 15:27:31.566974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 217/466] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:30 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:31.572339 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:31.573203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:31.579926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:31.580639 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.581602 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:31.582199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.874676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:31.883809 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-517d78a2-81a6-4676-9a54-2d7119072b5a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.315322 Jul 06 15:27:31.884569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 218/467] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:31 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:31.889895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:31.890669 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:31.897414 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:31.897865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.898631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:31.899059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.905987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:27:31.907377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:27:31.908088 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:27:31.908724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:27:31.909482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:27:31.928783 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:31.929607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.930613 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:31.931288 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:31.958458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Getting quotas for project a75a2d018dff40bfb9b5bd72a678826c. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:27:31.958458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Getting quotas for user 74581e9c5b27401686b40b2312a6f2fb and project a75a2d018dff40bfb9b5bd72a678826c. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:27:31.990737 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:27:31.995337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:27:32.095919 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8f34b4fd-fcff-4aa0-b41b-27d9372b6ba5 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005945 Jul 06 15:27:32.103171 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 250/468] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 06 15:27:32.109054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:32.111746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:32.121140 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:32.125750 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:32.126938 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:32.127621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:32.249702 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:32.257694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-123644ca-1238-4062-902f-e41806f05219 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.371924 Jul 06 15:27:32.259574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 219/469] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:31 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:32.265344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e504287f-964b-4b12-9536-8c3939ee4b75 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:32.270327 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e504287f-964b-4b12-9536-8c3939ee4b75 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:32.370555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e504287f-964b-4b12-9536-8c3939ee4b75 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:32.385489 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e504287f-964b-4b12-9536-8c3939ee4b75 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1219 microversion: 2.1 time: 0.124686 Jul 06 15:27:32.394301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 220/470] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:32 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:32.413884 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:32.427905 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-de23ea44-8325-4e14-a5de-2f15d1cfbe75 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.321138 Jul 06 15:27:32.428800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 251/471] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:32 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:32.591779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:32.593176 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:32.603446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:32.604182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:32.605150 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:32.605747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:32.811781 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:32.826738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0e3e13e5-55c5-4646-8adf-9701014b7b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.248801 Jul 06 15:27:32.828383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 221/472] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:32 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:32.904930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:32.905804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:32.915176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:32.915836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:32.916771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:32.917350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.113904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:33.123675 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ee050a21-7a09-4759-83cd-6212bdf9e3af tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.224206 Jul 06 15:27:33.124278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 252/473] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:32 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:33.276052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:33.277294 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:33.285001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.285840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.286923 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.287743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.412097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:33.412810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:33.418797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.419344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.420161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.420655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.425908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:33.437529 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:33.448286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1e4b71cc-7f25-4388-9e81-b1ff7bfefb5c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.176113 Jul 06 15:27:33.449587 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 222/474] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:33 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:33.454878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:33.456397 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:33.463160 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.463660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.464464 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.464896 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.506202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:33.516511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9a1caea2-8821-437e-a513-a285637116d7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1223 microversion: 2.1 time: 0.108032 Jul 06 15:27:33.529839 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 253/475] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:33 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:33.628615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:33.636285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-cd537afe-f1dd-4cc8-8758-5d317a48bf4a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.185276 Jul 06 15:27:33.636786 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 223/476] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:33 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:33.845640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:33.846244 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:33.852974 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.853622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.854568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:33.855099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:33.991488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:33.999361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b21d3e0c-9d23-478a-a39d-32fbea6ebd7d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.158405 Jul 06 15:27:34.000228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 254/477] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:33 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:34.141991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:34.142605 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:34.148738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.149190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.149952 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.150389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.281710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:34.289954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e0d1e50c-ea2c-430d-8828-61cfdc446666 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.152554 Jul 06 15:27:34.290519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 224/478] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:34 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:34.464829 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:34.465428 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:34.471941 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.472345 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.473090 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.473515 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.537384 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:34.537979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:34.543830 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.544278 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.545023 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.545451 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.602793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:34.606932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:34.610831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c71f6c07-56e3-4202-bad6-6725c4c14cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.149790 Jul 06 15:27:34.611437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 255/479] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:34 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:34.615670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-07f2daff-6d7a-429e-a47e-9024def42123 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1223 microversion: 2.1 time: 0.082064 Jul 06 15:27:34.623499 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 225/480] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:34 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:34.661945 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:34.667256 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:34.669116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.669565 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.670326 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:34.670768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:34.796564 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:34.803947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2ab71701-a19a-444c-85d2-8b2f42551e7a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.145821 Jul 06 15:27:34.804523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 256/481] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:34 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:35.016930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:35.017472 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:35.023411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.023856 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.024609 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.025044 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.159678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:35.167290 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ea9d4b59-1b08-4fa4-b43c-57ec28a5a5ae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1510 microversion: 2.1 time: 0.154854 Jul 06 15:27:35.167870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 226/482] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:35 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:35.307044 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:35.307620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:35.314066 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.314504 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.315270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.315697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.444951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:35.452836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-656031ea-855f-43be-82bd-fd45bce21ff6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.149829 Jul 06 15:27:35.453408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 257/483] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:35 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:35.628561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:35.629427 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:35.631998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:35.632606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:35.636121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.636571 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.637922 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.638380 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.638527 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.638972 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.639764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.640196 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.713800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:35.722592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c2ebf3ea-9e06-421c-869c-d60a59c2427b tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1223 microversion: 2.1 time: 0.094308 Jul 06 15:27:35.723606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 258/484] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:35 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:35.783153 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:35.790635 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bac38acf-59ee-4d96-ab47-597b5e6c80c1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.166751 Jul 06 15:27:35.791304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 227/485] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:35 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:35.820369 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:35.821177 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:35.826948 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.827461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.828428 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:35.828857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:35.953251 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:35.960603 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ce293a66-4498-4664-8365-32eaf261a58c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.144084 Jul 06 15:27:35.961171 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 259/486] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:35 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:36.184588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:36.185125 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:36.191991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.192450 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.193555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.193678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.462196 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:36.469485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:36.469672 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d57b8824-043c-4e68-a9a3-c2f99dab8090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1516 microversion: 2.1 time: 0.289287 Jul 06 15:27:36.470250 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 228/487] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:36 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:36.470385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:36.476774 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.477225 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.477987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.478426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.625197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:36.644790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-753adef0-d3fd-49f8-9273-4b6d36bb60f0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.170325 Jul 06 15:27:36.645445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 260/488] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:36 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:36.743313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:36.743912 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:36.750409 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.750849 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.751643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.752075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.808191 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:36.808943 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:36.824599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.827876 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.828984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:36.831171 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:36.962817 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:36.975605 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2fc09505-96bc-451f-b460-86f7c0466f8d tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1279 microversion: 2.1 time: 0.233136 Jul 06 15:27:36.984249 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 229/489] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:36 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1279 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:37.018123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:37.019396 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:37.030557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:37.031111 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:37.033587 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:37.034508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:37.039564 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:37.049315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4f051bb9-5988-4109-8b8d-ac7b889654a6 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.245217 Jul 06 15:27:37.049899 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 261/490] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:36 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:37.177585 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:37.185291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ad6b1f71-30c0-4f4f-a020-5cb4a6d199cb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.199037 Jul 06 15:27:37.185874 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 230/491] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:36 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:37.663051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:37.663602 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:37.670046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:37.670492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:37.671279 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:37.671721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:37.799361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:37.807262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b5a624ea-b538-4dc9-ad7a-ef6b7248b6f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.148120 Jul 06 15:27:37.807838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 262/492] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:37 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:37.946121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2e56791f-6095-41a2-8223-2967b0df452c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'create', calling method: .version_select at 0x7f449c573b80>, body: {"keypair": {"name": "tempest-keypair-866355635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYcdXWyZNcAH4Fs+scApDVwPXv+sBrEijgGQgq4OJHwOv76Kx+9cauHpcXaP+wOY4oIT899JevgVTqjhsWv6P6lV38AKfxlVim4Ez3uVa4aZOziyqVl3S1UtX3C+JwJcg=="}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:37.960965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-2e56791f-6095-41a2-8223-2967b0df452c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for project ef44ecc951964d51925463c5e09f9fbb. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:27:37.965391 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-2e56791f-6095-41a2-8223-2967b0df452c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for user 46896be59b73481287235aac3d630f4e and project ef44ecc951964d51925463c5e09f9fbb. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:27:37.996406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:37.997462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:38.000718 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2e56791f-6095-41a2-8223-2967b0df452c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057706 Jul 06 15:27:38.001640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 231/493] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:27:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:38.005363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.005992 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.007819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.008272 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.067309 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:38.068181 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:38.076725 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.077678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.080739 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.081927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.167340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:38.180481 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-773116c5-47fd-41b8-a2bc-45cd367932b0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1277 microversion: 2.1 time: 0.190823 Jul 06 15:27:38.181441 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 263/494] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:37 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:38.205219 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:38.208011 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:38.210811 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:38.229468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.235292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.237647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.254337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.450869 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:38.467075 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-546d09ea-81ab-411f-b747-ed957d536e17 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.268606 Jul 06 15:27:38.470314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 264/495] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:38 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:38.824115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:38.824768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:38.831409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.831861 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.832629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:38.833059 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:38.852155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:38.861357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-32fa82e3-d311-4e5f-9d73-96fb7d179ff7 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.798301 Jul 06 15:27:38.862197 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 232/496] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:38 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:38.969220 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:38.977523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4ce17dbc-2c6b-48e3-be3d-7c9a2fa264fd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.157203 Jul 06 15:27:38.978101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 265/497] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:38 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:39.198126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:39.198868 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:39.206000 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:39.206519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:39.207381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:39.207882 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:39.225969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=100 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:39.301128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:39.309441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1129b37c-918b-48d4-bd39-abd0c1a59bc2 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1277 microversion: 2.1 time: 0.115455 Jul 06 15:27:39.310233 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 233/498] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:39 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:39.486863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:39.487497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:39.493649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:39.494060 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:39.494775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:39.495198 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:39.659400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:39.667776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4f85faa2-0c55-4c2e-8260-d14d6841d50d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.185776 Jul 06 15:27:39.668431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 266/499] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:39 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:39.878061 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:39.878652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:39.886188 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:39.886779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:39.887891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:39.889423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:39.995709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:39.996943 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:40.005736 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.006186 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.006970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.007453 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.161916 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:40.173314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a4846081-e256-4d92-ac1a-5c2d4823969a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1710 microversion: 2.1 time: 0.181088 Jul 06 15:27:40.174391 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 267/500] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:39 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:40.187457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:40.195265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ab6874bb-3720-446a-b56c-3600d1c52332 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.321192 Jul 06 15:27:40.195934 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 234/501] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:39 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:40.327208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:40.327850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:40.334415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.335367 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.336521 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.336999 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.502619 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:40.512787 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b1cacdd1-c48e-4419-9468-672e7393dea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.189435 Jul 06 15:27:40.525063 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 268/502] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:40 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:40.686476 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:40.687098 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:40.697003 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.698058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.699709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.700509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.824938 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-612e3006-abc3-4574-9858-5b96720116d0 req-e66477e9-b9b5-4d1b-b28f-777c3a2beb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e", "tag": "6d8685b9-4818-46a3-85c7-7cb199efa0f6"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:40.841662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-612e3006-abc3-4574-9858-5b96720116d0 req-e66477e9-b9b5-4d1b-b28f-777c3a2beb57 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:40.844311 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-612e3006-abc3-4574-9858-5b96720116d0 req-e66477e9-b9b5-4d1b-b28f-777c3a2beb57 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:40.883190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-612e3006-abc3-4574-9858-5b96720116d0 req-e66477e9-b9b5-4d1b-b28f-777c3a2beb57 service nova] Creating event network-changed:6d8685b9-4818-46a3-85c7-7cb199efa0f6 for instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e on hv-cinder-84884 Jul 06 15:27:40.893610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-612e3006-abc3-4574-9858-5b96720116d0 req-e66477e9-b9b5-4d1b-b28f-777c3a2beb57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073022 Jul 06 15:27:40.897438 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 269/503] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:40.907638 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1958578432", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f7f712f-7346-42c2-b097-b4b48d9f78be"}], "security_groups": [{"name": "tempest-securitygroup--103567083"}], "key_name": "tempest-keypair-866355635", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:40.909821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:40.919630 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7a2a2eeb-4057-4d34-bc61-618aa5ff4fd7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.237296 Jul 06 15:27:40.920226 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 235/504] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:40 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:41.056791 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] validate_networks() for [('2f7f712f-7346-42c2-b097-b4b48d9f78be', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:27:41.189928 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:41.190624 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:41.197093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.197721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.198643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.199259 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.402937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:41.424227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7454afdf-989f-4b96-82b2-8a147c6ec90b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1714 microversion: 2.1 time: 0.238140 Jul 06 15:27:41.425348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 236/505] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:41 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:41.430260 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:41.431452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:41.441018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.441474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.442758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.443292 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.454417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:27:41.454869 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:27:41.455375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:27:41.455793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:27:41.456222 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:27:41.466265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.466748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.467704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.468135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.485506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for project ef44ecc951964d51925463c5e09f9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:27:41.489536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Getting quotas for user 46896be59b73481287235aac3d630f4e and project ef44ecc951964d51925463c5e09f9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:27:41.500366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:27:41.502715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:27:41.548868 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b3af377c-519e-451d-a6a9-58865251f11e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.649918 Jul 06 15:27:41.549566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 270/506] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:27:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:27:41.555193 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:41.556092 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:41.563304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.564003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.564838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.565411 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.570633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:41.591661 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:41.610479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-97731df7-2545-4af9-9582-176d25fc275c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.183794 Jul 06 15:27:41.611526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 237/507] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:41 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:41.623306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-260b0c2f-38ec-430c-bca2-03a35082c06f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:41.624175 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-260b0c2f-38ec-430c-bca2-03a35082c06f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:41.700636 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-260b0c2f-38ec-430c-bca2-03a35082c06f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:41.723068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-260b0c2f-38ec-430c-bca2-03a35082c06f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1245 microversion: 2.1 time: 0.110337 Jul 06 15:27:41.724796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 238/508] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:41 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:41.741435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:41.749100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dbd7afa2-3ba8-4487-900f-35ca2530b9f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.198317 Jul 06 15:27:41.750433 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 271/509] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:41 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:41.938748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:41.940400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:41.948809 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.949509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:41.950507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:41.951128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.129472 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:42.138575 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-189b0d1d-7060-4321-8dbb-70b20f190298 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.204712 Jul 06 15:27:42.139421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 239/510] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:41 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:42.629005 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:42.629881 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:42.637400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.637792 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.639087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.639574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.728766 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-5e752301-2bc2-4686-bc60-cc53f4bd2959 req-182172d7-38a2-48ae-84a2-31fbca8d08bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "name": "network-vif-plugged", "status": "completed", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:42.756352 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5e752301-2bc2-4686-bc60-cc53f4bd2959 req-182172d7-38a2-48ae-84a2-31fbca8d08bf service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.756984 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5e752301-2bc2-4686-bc60-cc53f4bd2959 req-182172d7-38a2-48ae-84a2-31fbca8d08bf service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.782925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-5e752301-2bc2-4686-bc60-cc53f4bd2959 req-182172d7-38a2-48ae-84a2-31fbca8d08bf service nova] Creating event network-vif-plugged:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:27:42.790709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-5e752301-2bc2-4686-bc60-cc53f4bd2959 req-182172d7-38a2-48ae-84a2-31fbca8d08bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066042 Jul 06 15:27:42.796425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 240/511] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:42.804316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:42.805030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:42.823420 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.823881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.824672 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.825108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.850770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:42.859305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ba4f168c-6253-4077-8e8f-b7c652611fff tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.235903 Jul 06 15:27:42.863736 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 272/512] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:42 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:42.870486 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:42.875107 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:42.897052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.897447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:42.898657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:42.899503 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:43.010826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:43.021006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f011110f-c8aa-427d-9e91-ae33eec17913 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1241 microversion: 2.1 time: 0.222522 Jul 06 15:27:43.021910 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 241/513] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:42 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:43.082368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:43.093098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-11d8e7d1-af70-4cb9-8a9b-100f4d64b133 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.227968 Jul 06 15:27:43.093951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 273/514] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:42 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:43.157111 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:43.158439 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:43.166951 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:43.182538 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:43.188180 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:43.188868 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:43.423207 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:43.432062 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1c00ba65-1034-410b-8243-2a1ff3a7b2fb tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.279250 Jul 06 15:27:43.432722 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 242/515] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:43 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:43.879429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:43.880606 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:43.887925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:43.888442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:43.889429 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:43.890065 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.038017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:44.038628 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:44.051447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:44.051604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.052102 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.052909 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.053348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.059875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5595ac34-86c7-4971-a876-3db30f8a7d23 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1359 microversion: 2.1 time: 0.186231 Jul 06 15:27:44.060535 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 274/516] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:43 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:44.110494 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:44.111109 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:44.117338 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.117781 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.120843 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.122646 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.158690 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:44.168908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8ffcd57d-315f-4dc5-993e-7ef98d1519eb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1241 microversion: 2.1 time: 0.134753 Jul 06 15:27:44.169791 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 243/517] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:44 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1241 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:44.306335 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:44.315965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c58fa1b0-3806-462e-ac9e-83bc15d003e7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.209666 Jul 06 15:27:44.316598 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 275/518] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:44 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:44.451631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:44.452398 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:44.460366 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.460810 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.461833 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.462380 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.639011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:44.646971 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-321e5708-786f-46a5-b4f8-125e90b1b1e7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.200849 Jul 06 15:27:44.647814 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 244/519] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:44 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:44.832395 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-44d5c569-b9cf-4b16-9abd-4b024d1d8699 req-7d72fa3f-094c-4fd7-8e68-bef776123434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44071dc-0ea5-446e-8cf3-8509970b78a8", "name": "network-vif-plugged", "status": "completed", "tag": "8b63513d-d499-47ba-b47f-6a4a11d9be7c"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:44.840658 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-44d5c569-b9cf-4b16-9abd-4b024d1d8699 req-7d72fa3f-094c-4fd7-8e68-bef776123434 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:44.841093 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-44d5c569-b9cf-4b16-9abd-4b024d1d8699 req-7d72fa3f-094c-4fd7-8e68-bef776123434 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:44.857121 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-44d5c569-b9cf-4b16-9abd-4b024d1d8699 req-7d72fa3f-094c-4fd7-8e68-bef776123434 service nova] Creating event network-vif-plugged:8b63513d-d499-47ba-b47f-6a4a11d9be7c for instance e44071dc-0ea5-446e-8cf3-8509970b78a8 on hv-cinder-84884 Jul 06 15:27:44.863512 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-44d5c569-b9cf-4b16-9abd-4b024d1d8699 req-7d72fa3f-094c-4fd7-8e68-bef776123434 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Jul 06 15:27:44.865131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 276/520] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:45.078359 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.079113 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:45.086375 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.086784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.087919 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.088683 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.187517 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.188353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:45.199030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.200396 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.201435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.202090 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.301741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:45.313974 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7fcb6a8f-f4ab-489e-8fab-5e5f27772920 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1297 microversion: 2.1 time: 0.131138 Jul 06 15:27:45.323355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 277/521] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1297 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:45.330182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:45.333090 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.333775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:45.340458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6b8b97ae-be08-4549-92bd-582dd0b3292d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1550 microversion: 2.1 time: 0.267003 Jul 06 15:27:45.340648 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.341255 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.342096 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.342828 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.354592 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 245/522] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1550 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:45.366526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.367602 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:45.380127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.380585 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.381370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.381796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.536243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:45.543692 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-18b931a7-f6db-4db5-bfda-b48524605291 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.214677 Jul 06 15:27:45.544266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 278/523] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:45.662355 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:45.665622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.666436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:45.673420 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0e64b8b3-5e25-465e-a871-af6b7a8af543 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1550 microversion: 2.1 time: 0.314063 Jul 06 15:27:45.679452 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.680269 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.681286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.681908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.685552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 246/524] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1550 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:45.692673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.696764 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:45.698403 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Searching by: {'deleted': False, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517'} {{(pid=117620) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 06 15:27:45.706912 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.707735 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.708649 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.710106 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.810431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.multi_cell_list [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117620) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 06 15:27:45.839054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:45.848072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-05923c23-9572-46a3-8d34-192ba194756b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.187426 Jul 06 15:27:45.848634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 279/525] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:45.904874 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-efe3f64a-01f7-42a7-93fb-beee7cdc1662 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217689 Jul 06 15:27:45.905467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 247/526] 10.222.0.46 () {58 vars in 1124 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:45.916524 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:45.917169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:45.923173 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.923657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:45.924422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:45.924854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.057106 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:46.064533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3373170a-f65a-4aed-a1a8-153fb86edd88 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1550 microversion: 2.1 time: 0.151870 Jul 06 15:27:46.065108 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 280/527] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:45 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:46.332414 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:46.333786 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:46.340476 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.340926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.341687 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.342549 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.441263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:46.456326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-daa83825-9acd-4f84-893d-c8628631b227 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1303 microversion: 2.1 time: 0.128928 Jul 06 15:27:46.456937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 248/528] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:46 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:46.562369 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:46.563805 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:46.572530 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.573446 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.574613 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.575052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.736568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:46.744359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a7ddb9ef-d241-4458-bd9f-f5d9c4cf8aa3 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.186681 Jul 06 15:27:46.745134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 281/529] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:46 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:46.867004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:46.867715 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:46.876030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.877264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.878192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.879434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.891089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-e19f3d3e-16ef-407b-b374-d2d8711c47c6 req-4da25289-5a83-4d23-81ac-5c9c9192bd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e", "name": "network-vif-plugged", "status": "completed", "tag": "6d8685b9-4818-46a3-85c7-7cb199efa0f6"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:46.903206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e19f3d3e-16ef-407b-b374-d2d8711c47c6 req-4da25289-5a83-4d23-81ac-5c9c9192bd37 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:46.904408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e19f3d3e-16ef-407b-b374-d2d8711c47c6 req-4da25289-5a83-4d23-81ac-5c9c9192bd37 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:46.920932 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-e19f3d3e-16ef-407b-b374-d2d8711c47c6 req-4da25289-5a83-4d23-81ac-5c9c9192bd37 service nova] Creating event network-vif-plugged:6d8685b9-4818-46a3-85c7-7cb199efa0f6 for instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e on hv-cinder-84884 Jul 06 15:27:46.925653 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-e19f3d3e-16ef-407b-b374-d2d8711c47c6 req-4da25289-5a83-4d23-81ac-5c9c9192bd37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040222 Jul 06 15:27:46.926249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 282/530] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:47.090400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:47.098982 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ed839448-aaa4-4ca1-8fe9-8451979d94a0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1366 microversion: 2.1 time: 0.237728 Jul 06 15:27:47.099592 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 249/531] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:46 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:47.474050 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:47.474745 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:47.480757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:47.481197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:47.481948 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:47.482374 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:47.626854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:47.634942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f6d8bd45-2188-4129-a418-89c3059f498f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.164955 Jul 06 15:27:47.635580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 283/532] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:47 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:47.682313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7d4e6cf-298d-449f-bafc-1e50c60a4c73"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:47.683455 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:47.689932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:47.690774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:47.691782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:47.692400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:47.761889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:47.762345 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:47.769554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:47.770608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:47.771892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:47.772734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:47.912882 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:47.920846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5ee95b14-7c67-495b-8ea3-6e23143ce4ee tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.162813 Jul 06 15:27:47.922996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 284/533] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:47 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:48.117256 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:48.118013 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:48.128035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.128638 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.129829 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.130363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.171803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:48.204383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a1fa426c-7ab8-4c5d-ba3e-c2b209a1c247 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524944 Jul 06 15:27:48.210125 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 250/534] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:27:47 2022] POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:48.388732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:48.399996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d4c15898-accb-4c1c-a3c1-9934fdb2e415 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1556 microversion: 2.1 time: 0.287150 Jul 06 15:27:48.400771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 285/535] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:48 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1556 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:48.426954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:48.428614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:48.446109 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.447622 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.448863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.450305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.574642 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-c7a2cd2a-1d1f-4434-9058-52a915b883c2 req-04f6e77e-cbd3-4b17-9b3b-5e4a07c7c449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc848c1-1535-4024-a792-3e74e6581844", "tag": "c1b8dfba-8c84-435a-984a-2a26f587b26e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:48.585233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c7a2cd2a-1d1f-4434-9058-52a915b883c2 req-04f6e77e-cbd3-4b17-9b3b-5e4a07c7c449 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.585890 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c7a2cd2a-1d1f-4434-9058-52a915b883c2 req-04f6e77e-cbd3-4b17-9b3b-5e4a07c7c449 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.599003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-c7a2cd2a-1d1f-4434-9058-52a915b883c2 req-04f6e77e-cbd3-4b17-9b3b-5e4a07c7c449 service nova] Creating event network-changed:c1b8dfba-8c84-435a-984a-2a26f587b26e for instance 3dc848c1-1535-4024-a792-3e74e6581844 on hv-cinder-84884 Jul 06 15:27:48.602773 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-41b551df-a1b3-410f-9157-8ac788f7a85d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187780 Jul 06 15:27:48.604004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 251/536] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:27:48 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:48.612979 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-c7a2cd2a-1d1f-4434-9058-52a915b883c2 req-04f6e77e-cbd3-4b17-9b3b-5e4a07c7c449 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044549 Jul 06 15:27:48.613716 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 286/537] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:48.652174 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:48.653049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:48.660214 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.660660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.661754 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.661995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.939475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:48.940210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:48.946406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.946858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:48.947654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:48.948089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:49.049460 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:49.056881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-89ea4ad2-0e95-43a5-ad6b-2fc3f417dacd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.408675 Jul 06 15:27:49.057455 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 252/538] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:48 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:49.128583 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:49.156369 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d51fb41a-a9ca-4c53-bda9-d3e3fedc0ea7 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.220782 Jul 06 15:27:49.169596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 287/539] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:48 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:50.079561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:50.081031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:50.095096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.101388 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.103107 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.105326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.105989 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.177074 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:50.178126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:50.185008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.185462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.186242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.186676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.350925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:50.389204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5a774ee4-1788-4a7a-95e5-b027b1ef58a0 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1508 microversion: 2.1 time: 0.215931 Jul 06 15:27:50.395104 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 288/540] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:50 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:27:50.412171 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f710e02-f1d5-48fd-a584-419ed75baefa", "device": "/dev/sdb"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:50.415760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:50.430667 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.431117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.431986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.432414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.493504 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:50.502942 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-455c1a36-507f-4fb5-86af-46f74045726f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.432035 Jul 06 15:27:50.515778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 253/541] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:50 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:50.598761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.630247 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-8e262f0c-ca51-48bf-9c3a-c9b95f15c0d0 req-a6e1db0c-4603-403e-8d74-9c3654f8c391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44071dc-0ea5-446e-8cf3-8509970b78a8", "tag": "8b63513d-d499-47ba-b47f-6a4a11d9be7c"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:50.639905 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-8e262f0c-ca51-48bf-9c3a-c9b95f15c0d0 req-a6e1db0c-4603-403e-8d74-9c3654f8c391 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:50.640941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-8e262f0c-ca51-48bf-9c3a-c9b95f15c0d0 req-a6e1db0c-4603-403e-8d74-9c3654f8c391 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:50.653678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-8e262f0c-ca51-48bf-9c3a-c9b95f15c0d0 req-a6e1db0c-4603-403e-8d74-9c3654f8c391 service nova] Creating event network-changed:8b63513d-d499-47ba-b47f-6a4a11d9be7c for instance e44071dc-0ea5-446e-8cf3-8509970b78a8 on hv-cinder-84884 Jul 06 15:27:50.660201 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-8e262f0c-ca51-48bf-9c3a-c9b95f15c0d0 req-a6e1db0c-4603-403e-8d74-9c3654f8c391 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033501 Jul 06 15:27:50.661031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 254/542] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:51.476864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.496155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.523676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:51.524612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:51.533022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:51.533638 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:51.534808 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:51.535264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:51.706363 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=8 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.733169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:51.743903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-52983e84-f219-40b2-b464-c221d633c1a8 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.225483 Jul 06 15:27:51.744481 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 255/543] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:51 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:51.847152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9f866212-1022-483e-a6a9-dadd3585dce4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "POST /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.445399 Jul 06 15:27:51.848024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 289/544] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:27:50 2022] POST /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e/os-volume_attachments => generated 194 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:52.767070 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:52.767676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:52.774093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:52.774542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:52.775333 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:52.775769 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:52.914987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:52.923625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-41d8c9f1-0436-4032-ad96-cd4be4508f13 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.160933 Jul 06 15:27:52.924198 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 256/545] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:52 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:53.941882 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:53.943314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:53.950573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:53.951328 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:53.952213 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:53.953336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:54.085556 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:54.093332 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0472bcd5-7ca7-4751-8f52-337f615b27ce tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.156630 Jul 06 15:27:54.093925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 290/546] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:53 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:55.110155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:55.110909 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:55.118547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:55.118990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:55.120194 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:55.121253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:55.251904 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:55.259232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9cdeb562-a01f-49b3-b7a4-7b84febfea9d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.152910 Jul 06 15:27:55.259798 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 257/547] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:55 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:56.277076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:56.277821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:56.285982 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:56.287317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:56.288185 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:56.288734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:56.436582 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:56.446919 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fa06d4b2-0113-447f-bdf4-8fb4b5b2cccb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.174044 Jul 06 15:27:56.447612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 291/548] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:56 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:56.616261 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-9713aad3-9115-4676-b71b-252e9f61e58b req-eff56a3e-4771-4ffb-9116-11f10348c918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc848c1-1535-4024-a792-3e74e6581844", "name": "network-vif-plugged", "status": "completed", "tag": "c1b8dfba-8c84-435a-984a-2a26f587b26e"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:56.619653 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:56.625790 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-9713aad3-9115-4676-b71b-252e9f61e58b req-eff56a3e-4771-4ffb-9116-11f10348c918 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:56.626232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-9713aad3-9115-4676-b71b-252e9f61e58b req-eff56a3e-4771-4ffb-9116-11f10348c918 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:56.637879 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-9713aad3-9115-4676-b71b-252e9f61e58b req-eff56a3e-4771-4ffb-9116-11f10348c918 service nova] Creating event network-vif-plugged:c1b8dfba-8c84-435a-984a-2a26f587b26e for instance 3dc848c1-1535-4024-a792-3e74e6581844 on hv-cinder-84884 Jul 06 15:27:56.643268 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-9713aad3-9115-4676-b71b-252e9f61e58b req-eff56a3e-4771-4ffb-9116-11f10348c918 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Jul 06 15:27:56.643857 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 258/549] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:27:56.945447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:56.946060 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:56.952481 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:56.952934 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:56.954406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:56.954842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:57.085310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:57.093153 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7fe5b9e4-a2e1-4ae7-bb02-3510d81624fd tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1596 microversion: 2.1 time: 0.151566 Jul 06 15:27:57.094213 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 292/550] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:56 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1596 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:57.464923 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:57.465614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:57.472213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:57.472656 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:57.473409 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:57.473837 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:57.694836 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:57.702512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b81d5d33-e264-4f17-8c78-95f041dedda0 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1370 microversion: 2.1 time: 0.241728 Jul 06 15:27:57.703654 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 259/551] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:57 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:58.720837 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:58.721463 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:58.727850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:58.728291 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:58.729041 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:58.729466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:58.860387 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:27:58.867920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-953879eb-1d40-49e5-a60f-3c74a0f70993 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1564 microversion: 2.1 time: 0.151475 Jul 06 15:27:58.869196 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 293/552] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:27:58 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:27:58.885095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:27:58.885577 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:27:58.892931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:58.893602 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:58.894373 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:58.894939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:58.923845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-5a5ee293-c2a2-406a-8632-9114765cc32c req-0d0a072a-e09d-4a5e-bd48-12c330241e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:27:58.932836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-5a5ee293-c2a2-406a-8632-9114765cc32c req-0d0a072a-e09d-4a5e-bd48-12c330241e58 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:27:58.933187 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-5a5ee293-c2a2-406a-8632-9114765cc32c req-0d0a072a-e09d-4a5e-bd48-12c330241e58 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:27:58.946823 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-5a5ee293-c2a2-406a-8632-9114765cc32c req-0d0a072a-e09d-4a5e-bd48-12c330241e58 service nova] Creating event network-changed:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:27:58.953315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-5a5ee293-c2a2-406a-8632-9114765cc32c req-0d0a072a-e09d-4a5e-bd48-12c330241e58 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Jul 06 15:27:58.957141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 294/553] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:27:58.986007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-20576fc7-3372-435c-bce0-291cfeef765d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104990 Jul 06 15:27:58.986596 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 260/554] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:27:58 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:28:00.002028 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1808262137"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:00.002559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:00.011263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:00.011705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:00.012481 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:00.012923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:00.178351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.network.security_group_api [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Adding security group 5fee6c02-3f56-4a46-8ff0-68420d1be68a to port 06b84364-8b0e-41bc-bdb2-0e28411c93d0 Jul 06 15:28:00.630151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a61975e6-974d-4c3f-b912-3b0d96e96cd2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/action" status: 202 len: 0 microversion: 2.1 time: 0.637884 Jul 06 15:28:00.631048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 295/555] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:27:59 2022] POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:28:00.646178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:00.647432 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:00.648338 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-29a1091b-6da9-42bd-ad71-cbf6d6a92bbd req-552bdd49-46be-4352-8676-be1a4bd3d6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:00.685637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:00.686483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:00.691262 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:00.693305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-29a1091b-6da9-42bd-ad71-cbf6d6a92bbd req-552bdd49-46be-4352-8676-be1a4bd3d6b7 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:00.693751 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-29a1091b-6da9-42bd-ad71-cbf6d6a92bbd req-552bdd49-46be-4352-8676-be1a4bd3d6b7 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:00.695115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:00.732511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-29a1091b-6da9-42bd-ad71-cbf6d6a92bbd req-552bdd49-46be-4352-8676-be1a4bd3d6b7 service nova] Creating event network-changed:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:28:00.737962 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-29a1091b-6da9-42bd-ad71-cbf6d6a92bbd req-552bdd49-46be-4352-8676-be1a4bd3d6b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099503 Jul 06 15:28:00.739013 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 296/556] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:28:00.967579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:00.976766 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-c3af3c39-23fb-4772-9d40-48a16cf7620d req-b375e3c4-5d8f-4524-9703-e9746133b81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc848c1-1535-4024-a792-3e74e6581844", "tag": "c1b8dfba-8c84-435a-984a-2a26f587b26e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:00.976996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a9fe85dc-9614-4aae-a026-4991707bb1f2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1761 microversion: 2.1 time: 0.341495 Jul 06 15:28:00.977798 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 261/557] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:00 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1761 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:00.989784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c3af3c39-23fb-4772-9d40-48a16cf7620d req-b375e3c4-5d8f-4524-9703-e9746133b81b service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:00.990386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c3af3c39-23fb-4772-9d40-48a16cf7620d req-b375e3c4-5d8f-4524-9703-e9746133b81b service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:01.002568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-c3af3c39-23fb-4772-9d40-48a16cf7620d req-b375e3c4-5d8f-4524-9703-e9746133b81b service nova] Creating event network-changed:c1b8dfba-8c84-435a-984a-2a26f587b26e for instance 3dc848c1-1535-4024-a792-3e74e6581844 on hv-cinder-84884 Jul 06 15:28:01.007686 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-c3af3c39-23fb-4772-9d40-48a16cf7620d req-b375e3c4-5d8f-4524-9703-e9746133b81b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035625 Jul 06 15:28:01.008757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 297/558] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:28:15.385572 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:15.386062 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:15.388759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=16 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:15.389461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:15.395144 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:15.395683 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:15.396533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:15.396974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:15.523002 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lazy-loading 'services' on Instance uuid 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:28:15.631803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-44eed7c8-4f8b-4351-acba-2473dc4f83f4 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "DELETE /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e/os-volume_attachments/8f710e02-f1d5-48fd-a584-419ed75baefa" status: 202 len: 0 microversion: 2.1 time: 0.249912 Jul 06 15:28:15.632399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 262/559] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:28:15 2022] DELETE /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e/os-volume_attachments/8f710e02-f1d5-48fd-a584-419ed75baefa => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:28:32.543116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:32.543736 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:32.546784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:32.547509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:32.554006 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:32.554446 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:32.555197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:32.555648 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:32.583966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:28:32.655877 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8e029124-b296-4d18-999f-4fb6e1fd495e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "DELETE /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 204 len: 0 microversion: 2.1 time: 0.116620 Jul 06 15:28:32.656652 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 298/560] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:28:32 2022] DELETE /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:28:32.665044 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:32.665801 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:32.668458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:32.669155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:32.674992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:32.675466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:32.676718 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:32.677157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:32.805300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:32.812880 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-cff533d0-bf4c-4995-8d95-d60afc8ecb25 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1514 microversion: 2.1 time: 0.152001 Jul 06 15:28:32.813449 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 263/561] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:32 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:33.830435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:33.831111 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:33.838021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:33.838458 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:33.839204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:33.839652 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:33.972197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:33.979663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8fd5b444-ae92-40b3-b13a-75207bf3fc28 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1514 microversion: 2.1 time: 0.153401 Jul 06 15:28:33.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 299/562] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:33 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:34.996714 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:34.997372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:35.003936 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:35.004428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:35.005192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:35.005620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:35.225903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74581e9c5b27401686b40b2312a6f2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75a2d018dff40bfb9b5bd72a678826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:35.233832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0f608014-369e-4beb-8fbd-48764f1da259 tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 200 len: 1514 microversion: 2.1 time: 0.241002 Jul 06 15:28:35.235151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 264/563] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:34 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:35.282915 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-4f4320cd-517f-4bab-8f50-7eaf46633d43 req-1ed7ab3e-ff25-4497-89ae-b4395b799a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e", "name": "network-vif-deleted", "tag": "6d8685b9-4818-46a3-85c7-7cb199efa0f6"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:35.291547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4f4320cd-517f-4bab-8f50-7eaf46633d43 req-1ed7ab3e-ff25-4497-89ae-b4395b799a3f service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:35.291937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4f4320cd-517f-4bab-8f50-7eaf46633d43 req-1ed7ab3e-ff25-4497-89ae-b4395b799a3f service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:35.304924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-4f4320cd-517f-4bab-8f50-7eaf46633d43 req-1ed7ab3e-ff25-4497-89ae-b4395b799a3f service nova] Creating event network-vif-deleted:6d8685b9-4818-46a3-85c7-7cb199efa0f6 for instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e on hv-cinder-84884 Jul 06 15:28:35.310048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-4f4320cd-517f-4bab-8f50-7eaf46633d43 req-1ed7ab3e-ff25-4497-89ae-b4395b799a3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Jul 06 15:28:35.311461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 300/564] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:28:36.250328 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:36.251006 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] [instance: 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:36.257441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:36.257880 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:36.258623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:36.259046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:36.271761 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] HTTP exception thrown: Instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e could not be found. Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Request method failure captured: Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e HTTP/1.1 Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixal4CG6M7OaoHkXr2TipVLLEBN5suZpryqioRN5FWeOD4sMG5YVq8loagDjx41CSVQcl2eAuLP2lwNLH-JuXHe-GGulS_CoCAIFEcQGdfOy_OhO3TAb78gqfr3yiNhlokIvyRwOD3rpg0ZW_LWVTm_nAv3v1HBNcIQtm6TDDX1IFuOs Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: a75a2d018dff40bfb9b5bd72a678826c Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesSnapshotTestJSON-376915781 Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:28:36.273344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a75a2d018dff40bfb9b5bd72a678826c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesSnapshotTestJSON-376915781 Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: a75a2d018dff40bfb9b5bd72a678826c Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-376915781 Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesSnapshotTestJSON-376915781-project Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 74581e9c5b27401686b40b2312a6f2fb Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesSnapshotTestJSON-376915781-project Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e could not be found. Jul 06 15:28:36.274931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e'} Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e could not be found. Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:28:36.275859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e could not be found. Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e could not be found. Jul 06 15:28:36.277094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:28:36.278536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] Returning 404 to user: Instance 177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:28:36.278536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-65c9dd16-b4c0-4add-9daf-e02f0762725e tempest-VolumesSnapshotTestJSON-376915781 tempest-VolumesSnapshotTestJSON-376915781-project] 10.222.0.46 "GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e" status: 404 len: 111 microversion: 2.1 time: 0.028239 Jul 06 15:28:36.278536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 265/565] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:36 2022] GET /compute/v2.1/servers/177ea1c5-e5ee-4f5d-af87-0f63cb2d3f7e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:28:43.384144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:43.384729 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:43.391280 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:43.391734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:43.392492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:43.392918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:43.474836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lazy-loading 'services' on Instance uuid 3811251a-a0ba-4f29-9160-96c0f3f46c52 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:28:43.550902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b7d08f23-2789-4751-bcc4-f672f8eebfa6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-volume_attachments/f839319d-2aff-4bb8-a297-fbac50d30cd2" status: 202 len: 0 microversion: 2.1 time: 0.172040 Jul 06 15:28:43.551625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 301/566] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:28:43 2022] DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-volume_attachments/f839319d-2aff-4bb8-a297-fbac50d30cd2 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:28:45.718872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-67917b80-8dcc-4325-8ee9-0a0b813813c9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:45.725705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-67917b80-8dcc-4325-8ee9-0a0b813813c9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:45.726147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-67917b80-8dcc-4325-8ee9-0a0b813813c9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:45.785908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-67917b80-8dcc-4325-8ee9-0a0b813813c9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Going to try to stop instance {{(pid=117620) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 06 15:28:45.827204 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-67917b80-8dcc-4325-8ee9-0a0b813813c9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action" status: 202 len: 0 microversion: 2.1 time: 0.112128 Jul 06 15:28:45.827810 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 266/567] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:28:45 2022] POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:28:45.837187 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:45.837875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:45.844010 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:45.844445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:45.845186 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:45.845611 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:45.972239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:45.980151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-187dc4d0-d159-47e7-9367-bd3ec29670bc tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.148053 Jul 06 15:28:45.980697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 302/568] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:45 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:46.998480 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:46.999176 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:47.005332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:47.005785 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:47.006543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:47.006980 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:47.138755 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:47.146097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-64c5e133-450c-4de4-a33e-06a2d7859e80 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.152265 Jul 06 15:28:47.146591 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 267/569] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:46 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:48.163357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:48.163971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:48.170753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:48.170905 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:48.171852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:48.172161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:48.309590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:48.316891 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-30a78ed0-d2a8-4bde-a65d-bb55c1079819 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.157460 Jul 06 15:28:48.317455 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 303/570] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:48 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:49.335467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:49.336158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:49.342817 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:49.343305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:49.344063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:49.344499 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:49.472077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:49.479641 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-456fa5ac-3f64-415d-a7de-39c3940cc17a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.149575 Jul 06 15:28:49.480201 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 268/571] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:49 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:50.496708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:50.497313 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:50.503676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:50.504099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:50.504852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:50.505279 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:50.635012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:50.643308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7bb1b08a-a20f-41d2-878a-73ee8eaebdb7 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.150500 Jul 06 15:28:50.643929 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 304/572] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:50 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:50.914646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:50.915700 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:50.922171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:50.922620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:50.923410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:50.923846 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:50.993281 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-56edf066-b044-4f5f-aa57-0996796e0caf tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/action" status: 202 len: 0 microversion: 2.1 time: 0.082403 Jul 06 15:28:50.994030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 269/573] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:28:50 2022] POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:28:51.002961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:51.003709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:51.010539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:51.011095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:51.012002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:51.012649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:51.166636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:51.174341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e5b3c2db-aeb6-480d-996a-3b5078ec42a2 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1753 microversion: 2.1 time: 0.175547 Jul 06 15:28:51.174913 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 305/574] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:50 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:51.664117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:51.664806 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:51.671620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:51.672084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:51.672911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:51.673512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:51.817115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:51.824461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-41a25ffe-6ef9-403f-8b85-a456f941875f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.166350 Jul 06 15:28:51.825017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 270/575] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:51 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:52.192207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:52.192857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:52.200242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:52.200687 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:52.201446 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:52.201879 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:52.342772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:52.350889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-20fc39da-261c-42f0-8e7b-1fbe9e469593 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.162673 Jul 06 15:28:52.351502 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 306/576] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:52 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:52.841112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:52.841708 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:52.848026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:52.848463 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:52.849237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:52.850406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:52.981372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:52.988787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-54b55338-0f77-4c7b-a106-0471a8ce5d78 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.151506 Jul 06 15:28:52.989340 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 271/577] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:52 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:53.368140 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:53.368741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:53.375409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:53.375855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:53.376615 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:53.377078 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:53.513267 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:53.521141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1a61bbf0-0429-4025-ad05-1113ed58a0d8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.156894 Jul 06 15:28:53.522220 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 307/578] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:53 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:54.006821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:54.007580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:54.013843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:54.014236 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:54.015004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:54.015468 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:54.140540 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:54.147893 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7379888b-4a2e-483d-9284-a89e41a9b927 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.145992 Jul 06 15:28:54.148443 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 272/579] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:54 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:54.539635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:54.540298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:54.546654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:54.547095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:54.547871 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:54.548300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:54.691111 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:54.699069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d3a183ee-a97d-4918-b527-16baa477e10c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.164085 Jul 06 15:28:54.699691 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 308/580] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:54 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:55.165038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:55.165676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:55.172100 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:55.172541 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:55.173324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:55.173790 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:55.302856 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:55.310284 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c2627000-b472-4df6-aec6-620082a7f13b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.149172 Jul 06 15:28:55.310847 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 273/581] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:55 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:55.715117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:55.715771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:55.722127 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:55.722576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:55.723366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:55.723801 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:55.862694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:55.871381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-863917f6-4c1e-4ea3-a34e-7e787817a7f8 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.160075 Jul 06 15:28:55.872274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 309/582] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:55 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:56.328026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:56.328684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:56.335110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:56.336257 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:56.337078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:56.337509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:56.455916 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b80a963-7a56-4bc9-b9ae-471da0a72d7e"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:56.457315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:56.463931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:56.464373 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:56.465129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:56.465561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:56.468541 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:56.476890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-443f1964-028d-4c0b-bde1-a02474f9e03d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.152629 Jul 06 15:28:56.477467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 274/583] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:56 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:56.716644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-925b1900-b360-446c-92e5-78537f7f8dfc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264479 Jul 06 15:28:56.717462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 310/584] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:28:56 2022] POST /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:28:56.889535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:56.890167 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:56.896372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:56.896821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:56.897571 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:56.898026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:57.053105 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:57.072524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b2c3a0f2-2a34-4895-9e47-3a611ffcdbad tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.186632 Jul 06 15:28:57.073115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 275/585] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:56 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:57.495754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:57.496480 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:57.502812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:57.503295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:57.504086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:57.504513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:57.522430 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:57.637853 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:57.645264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fd4b2203-e05b-4190-a227-1dc75437f347 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1678 microversion: 2.1 time: 0.155106 Jul 06 15:28:57.645842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 311/586] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:57 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:58.014422 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:58.014954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:58.021269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.021711 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.022452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.022888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.048444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b0044c11-c4b4-4ce8-86ea-f619bd30ac66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/ips" status: 200 len: 149 microversion: 2.1 time: 0.037842 Jul 06 15:28:58.048986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 276/587] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:28:58 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:28:58.059260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7624e95e-0f14-4fac-bac5-f752894d60b5"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:58.060349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:58.067042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.067533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.068293 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.068744 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.089584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:58.090190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:58.096868 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.097313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.098067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.098494 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.156889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Invalid volume: volume 7624e95e-0f14-4fac-bac5-f752894d60b5 is already attached to instances: a347082e-a86f-46f0-a018-e3918e3e8262 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: POST /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/os-volume_attachments HTTP/1.1 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 74 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:28:58.160168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {"volumeAttachment": {"volumeId": "7624e95e-0f14-4fac-bac5-f752894d60b5"}} Jul 06 15:28:58.161688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Invalid volume: volume 7624e95e-0f14-4fac-bac5-f752894d60b5 is already attached to instances: a347082e-a86f-46f0-a018-e3918e3e8262 Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'server_id': 'e44071dc-0ea5-446e-8cf3-8509970b78a8', 'body': {'volumeAttachment': {'volumeId': '7624e95e-0f14-4fac-bac5-f752894d60b5'}}} Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7624e95e-0f14-4fac-bac5-f752894d60b5 is already attached to instances: a347082e-a86f-46f0-a018-e3918e3e8262 Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:28:58.162442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7624e95e-0f14-4fac-bac5-f752894d60b5 is already attached to instances: a347082e-a86f-46f0-a018-e3918e3e8262 Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:28:58.163673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7624e95e-0f14-4fac-bac5-f752894d60b5 is already attached to instances: a347082e-a86f-46f0-a018-e3918e3e8262 Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 400 to user: Invalid volume: volume 7624e95e-0f14-4fac-bac5-f752894d60b5 is already attached to instances: a347082e-a86f-46f0-a018-e3918e3e8262 {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-569d578c-63a0-4be9-8100-2d118b8e37c3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106431 Jul 06 15:28:58.164885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 312/588] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:28:58 2022] POST /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:28:58.172694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:58.173578 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:58.179830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.180277 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.181048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.181485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.207392 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:28:58.250985 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:58.259943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-64ed19de-70ab-4d4f-9de0-a927388d99b1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.174321 Jul 06 15:28:58.260665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 277/589] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:58 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:28:58.290866 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-217de950-4b9e-4758-9e0c-6e7a2a467aa2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 204 len: 0 microversion: 2.1 time: 0.123099 Jul 06 15:28:58.291416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 313/590] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:28:58 2022] DELETE /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 15:28:58.300413 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:58.301016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:58.307554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.307995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.308898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.309326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.326821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:58.446281 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:58.453729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-79e7fee7-e91e-4d21-ba8a-3df53873ecc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1680 microversion: 2.1 time: 0.157961 Jul 06 15:28:58.454311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 278/591] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:58 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:58.662933 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:58.664313 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:58.670637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.671082 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.671948 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.672393 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.893334 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:58.901722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a8e4a722-a59f-4dd4-9535-a779043ff49d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1655 microversion: 2.1 time: 0.243152 Jul 06 15:28:58.911620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 314/592] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:58 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1655 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:28:58.918894 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d9ae1778-765e-42f5-a1ee-4a88d47c9f1f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:28:58.924946 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d9ae1778-765e-42f5-a1ee-4a88d47c9f1f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:58.925389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d9ae1778-765e-42f5-a1ee-4a88d47c9f1f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:58.948948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d9ae1778-765e-42f5-a1ee-4a88d47c9f1f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Going to try to start instance {{(pid=117620) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 06 15:28:58.996148 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d9ae1778-765e-42f5-a1ee-4a88d47c9f1f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action" status: 202 len: 0 microversion: 2.1 time: 0.080924 Jul 06 15:28:58.996764 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 279/593] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:28:58 2022] POST /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:28:59.004864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:59.005479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:59.011584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:59.012026 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:59.012782 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:59.013208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:59.146865 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:59.154665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9fdebfdb-a260-4e88-940e-3a4d0296fa59 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1664 microversion: 2.1 time: 0.153708 Jul 06 15:28:59.155248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 315/594] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:58 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:28:59.279190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:59.279981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:59.286569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:59.287023 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:59.287822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:59.288274 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:59.477342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:28:59.478336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:28:59.496450 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:59.497237 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:59.498826 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:28:59.499824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:28:59.654162 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:59.661772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-32494bf1-2deb-4432-8244-269fb1e6b763 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1680 microversion: 2.1 time: 0.192016 Jul 06 15:28:59.662707 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 316/595] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:59 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:28:59.797435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:28:59.807311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6e7230ca-9b9d-49ad-88d8-3a4c7dff8802 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.532302 Jul 06 15:28:59.814390 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 280/596] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:28:59 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:00.173350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:00.174812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:00.182879 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:00.183452 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:00.184287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:00.184788 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:00.368053 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:00.377003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bb2db38c-fc6c-476e-93a6-4e8721323d45 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1664 microversion: 2.1 time: 0.207813 Jul 06 15:29:00.377924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 317/597] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:00 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1664 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:00.680360 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:00.681023 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:00.688564 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:00.689229 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:00.690349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:00.690852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:00.811813 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:00.821705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-56b29236-42b7-4c77-86c6-2eab28a3753f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1613 microversion: 2.1 time: 0.145641 Jul 06 15:29:00.831323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 281/598] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:00 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1613 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:00.831533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:00.831533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:00.833702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:00.834158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:00.834944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:00.835436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.048936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:01.062562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c9716a5f-12db-4905-93a9-45362038ab49 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.240770 Jul 06 15:29:01.065588 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 318/599] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:00 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:29:01.112230 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-294b908a-db45-4d82-8fe0-97cd40fb9f6a req-48356589-a140-4486-ac9b-d2b46fcbe1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44071dc-0ea5-446e-8cf3-8509970b78a8", "name": "network-vif-deleted", "tag": "8b63513d-d499-47ba-b47f-6a4a11d9be7c"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:01.121277 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-294b908a-db45-4d82-8fe0-97cd40fb9f6a req-48356589-a140-4486-ac9b-d2b46fcbe1f6 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:01.121699 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-294b908a-db45-4d82-8fe0-97cd40fb9f6a req-48356589-a140-4486-ac9b-d2b46fcbe1f6 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.134182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-294b908a-db45-4d82-8fe0-97cd40fb9f6a req-48356589-a140-4486-ac9b-d2b46fcbe1f6 service nova] Creating event network-vif-deleted:8b63513d-d499-47ba-b47f-6a4a11d9be7c for instance e44071dc-0ea5-446e-8cf3-8509970b78a8 on hv-cinder-84884 Jul 06 15:29:01.140471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-294b908a-db45-4d82-8fe0-97cd40fb9f6a req-48356589-a140-4486-ac9b-d2b46fcbe1f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Jul 06 15:29:01.141114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 282/600] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:01.396416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:01.397023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:01.404639 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:01.405312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.407087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:01.407723 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.685847 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:01.699529 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-76ce6748-dbf8-49bc-8988-80a374b2de84 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1664 microversion: 2.1 time: 0.307391 Jul 06 15:29:01.700136 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 319/601] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:01 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1664 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:01.839014 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:01.840472 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:01.849396 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:01.850116 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.852394 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:01.853059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.897368 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:01.897470 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:01.897843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lazy-loading 'fault' on Instance uuid e44071dc-0ea5-446e-8cf3-8509970b78a8 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:29:01.951312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:01.959435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-06cf6355-98b3-4068-a23f-33c512d6c15a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 200 len: 1331 microversion: 2.1 time: 0.124773 Jul 06 15:29:01.960524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 283/602] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:01 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:02.083972 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:02.085166 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:02.097944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:02.100567 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:02.103346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:02.105105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:02.469414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:02.485319 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-166c8f60-c002-46bf-ad36-bb86346d3699 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.404146 Jul 06 15:29:02.486199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 320/603] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:02 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:02.724888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:02.725724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:02.728574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=45 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:02.736072 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:02.736635 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:02.737647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:02.748513 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:02.900901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:02.914533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-46fd27e7-2a8f-4d2b-9a49-37cedd1c0854 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1668 microversion: 2.1 time: 0.200050 Jul 06 15:29:02.915508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 284/604] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:02 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:02.979431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:02.980039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:02.983519 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:02.990800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:02.991688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:02.993019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:02.993500 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:03.027152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 HTTP/1.1 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:29:03.029085 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:29:03.030637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'e44071dc-0ea5-446e-8cf3-8509970b78a8'} Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:29:03.031412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:29:03.032593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:03.033627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:29:03.033627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f53f9735-d1af-415b-8e35-6a1fcb2caa2f tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 404 len: 111 microversion: 2.1 time: 0.056259 Jul 06 15:29:03.033627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 321/605] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:02 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:29:03.040404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9a87ac2f-26da-4c27-9393-c667ac7945ec tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '.version_select at 0x7f449c360040>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:03.061386 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9a87ac2f-26da-4c27-9393-c667ac7945ec tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-667302855" status: 202 len: 0 microversion: 2.1 time: 0.025505 Jul 06 15:29:03.061978 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 285/606] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jul 6 15:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-667302855 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:29:03.505964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:03.508748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:03.522445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:03.527652 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:03.529121 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:03.531362 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:03.859291 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:03.876435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-94916d9b-30fc-4e43-96c1-f2afec8f1aab tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.377083 Jul 06 15:29:03.877299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 322/607] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:03 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:04.073948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:04.074664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:04.082769 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.083447 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.085155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.086227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.175118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lazy-loading 'services' on Instance uuid a347082e-a86f-46f0-a018-e3918e3e8262 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:29:04.313283 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-faa0c1fc-0fb3-4389-a640-39b438d1e6ad tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments/7624e95e-0f14-4fac-bac5-f752894d60b5" status: 202 len: 0 microversion: 2.1 time: 0.244239 Jul 06 15:29:04.314157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 286/608] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:29:04 2022] DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments/7624e95e-0f14-4fac-bac5-f752894d60b5 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:29:04.322919 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:04.323976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:04.336610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.337084 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.337922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.338351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.394480 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eda26d6b-1d73-4e8d-899a-27ba0a006a7e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075391 Jul 06 15:29:04.398425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 323/609] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:29:04 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:04.469005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:04.470333 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:04.485320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.485776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.486561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.486998 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.542559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'flavor' on Instance uuid 3dc848c1-1535-4024-a792-3e74e6581844 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:29:04.722423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b22d2ad7-1d75-4e6d-bb5b-0f7fb407e2f9 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/action" status: 200 len: 32 microversion: 2.1 time: 0.257319 Jul 06 15:29:04.724459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 287/610] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:29:04 2022] POST /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:29:04.732852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:04.733457 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:04.740601 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.741051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.741852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.742286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.894651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:04.895648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:04.906626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.907412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:04.908387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:04.909956 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.040437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:05.049430 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-85365bf9-efa8-4591-b7d3-56ee02ea0dae tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.320463 Jul 06 15:29:05.050015 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 324/611] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:04 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:05.292015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:05.302311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-82803294-ba92-491a-8a71-00c6e2723318 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.412013 Jul 06 15:29:05.306146 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 288/612] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:04 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:05.406713 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:05.407729 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:05.417873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:05.418327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.419124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:05.419582 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.457086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0bf7b655-6a5b-439f-b7c5-3da8523c6fcf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054818 Jul 06 15:29:05.457908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 325/613] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:29:05 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:29:05.537458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:05.538191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:05.546483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:05.547032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.548119 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:05.548626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.584666 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Going to try to terminate instance {{(pid=117620) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:29:05.691986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1597dfd8-d0ad-4fc3-85ac-bfb371081781 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 204 len: 0 microversion: 2.1 time: 0.158247 Jul 06 15:29:05.692583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 289/614] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:29:05 2022] DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:29:05.702907 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:05.703922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:05.711188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:05.711666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.712500 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:05.712990 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:05.930752 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:05.939316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-00ac133e-5142-495f-8512-fa06af0bc2f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1682 microversion: 2.1 time: 0.240988 Jul 06 15:29:05.940425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 326/615] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:05 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:06.066692 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:06.067417 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:06.074858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:06.075407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:06.076178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:06.076611 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:06.254157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:06.262583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2203eca6-49db-4af7-ba62-2193ee3ebbc1 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.200013 Jul 06 15:29:06.267680 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 290/616] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:06 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:06.323922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:06.324709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:06.340927 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:06.341371 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:06.342139 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:06.342567 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:06.347071 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:06.509516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:06.521854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-02ad3060-562a-4111-b81f-0bf4b78f5437 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.203186 Jul 06 15:29:06.522445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 327/617] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:06 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:06.956829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:06.957860 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:06.967052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:06.967938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:06.968736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:06.969296 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:06.986415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:07.279858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:07.280390 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:07.287003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:07.287487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:07.288260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:07.288859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:07.437662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:07.447566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-076135cb-23b7-481d-a3f8-22fbf6d986aa tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.171845 Jul 06 15:29:07.457692 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 328/618] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:07 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:29:07.510678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:07.518759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d06ee2f4-1843-40a9-90d5-0805af27398a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1682 microversion: 2.1 time: 0.565693 Jul 06 15:29:07.519655 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 291/619] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:06 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1682 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:07.542435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:07.543289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:07.550020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:07.550470 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:07.551809 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:07.552400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:07.737546 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:07.749557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-04972a87-f932-48e6-a3e8-7355c77e5557 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.210733 Jul 06 15:29:07.763359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 329/620] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:07 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:08.465114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:08.465707 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:08.476890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.477344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.490751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.493631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.536926 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:08.537547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:08.553836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.554850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.555663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.556091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.818340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:08.846812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-57b18531-1520-4b97-9222-511be7586da4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 200 len: 1614 microversion: 2.1 time: 0.311957 Jul 06 15:29:08.854900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 330/621] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:08 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 1614 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:08.862859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-6b261f1a-fcaa-438c-91ef-bbdf562ff3a9 req-e39f79d5-5b45-432e-a08a-8f98aa0af5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a347082e-a86f-46f0-a018-e3918e3e8262", "name": "network-vif-deleted", "tag": "1517f5a9-ced9-4ab6-a63d-d158af2a6089"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:08.876046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6b261f1a-fcaa-438c-91ef-bbdf562ff3a9 req-e39f79d5-5b45-432e-a08a-8f98aa0af5c3 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.876832 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6b261f1a-fcaa-438c-91ef-bbdf562ff3a9 req-e39f79d5-5b45-432e-a08a-8f98aa0af5c3 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.892426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-6b261f1a-fcaa-438c-91ef-bbdf562ff3a9 req-e39f79d5-5b45-432e-a08a-8f98aa0af5c3 service nova] Creating event network-vif-deleted:1517f5a9-ced9-4ab6-a63d-d158af2a6089 for instance a347082e-a86f-46f0-a018-e3918e3e8262 on hv-cinder-84884 Jul 06 15:29:08.903450 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-6b261f1a-fcaa-438c-91ef-bbdf562ff3a9 req-e39f79d5-5b45-432e-a08a-8f98aa0af5c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043366 Jul 06 15:29:08.905124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 331/622] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:08.918087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:08.918799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:08.928172 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.928894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.930863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:08.931530 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:08.944184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:08.953532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-295c9875-31b0-4464-950c-fac634ccba77 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.492434 Jul 06 15:29:08.961184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 292/623] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:08 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:09.595600 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:09.605627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dcfe6c7e-cc55-4bff-8468-258d2212b714 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.694330 Jul 06 15:29:09.606361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 332/624] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:08 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:09.866500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:09.868665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:09.878775 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:09.879516 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:09.880462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:09.881337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:09.896888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 HTTP/1.1 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:29:09.899710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:29:09.901263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'a347082e-a86f-46f0-a018-e3918e3e8262'} Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:29:09.902379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:29:09.903789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:29:09.905793 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:29:09.907266 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2f161655-1a81-4a71-b7a7-20775e65220b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 404 len: 111 microversion: 2.1 time: 0.046128 Jul 06 15:29:09.909342 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 293/625] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:09 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:29:09.917555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1f19d9a1-7195-43da-9795-edb6344964bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '.version_select at 0x7f449cc04820>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:09.953471 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1f19d9a1-7195-43da-9795-edb6344964bf tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449558180" status: 202 len: 0 microversion: 2.1 time: 0.036525 Jul 06 15:29:09.958883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 333/626] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jul 6 15:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449558180 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:29:09.979404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:09.980371 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:09.988610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:09.989073 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:09.989859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:09.990293 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:10.283374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:10.294987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-07e88b2c-f6b9-4e36-aeed-d5a81b23e733 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.320909 Jul 06 15:29:10.295614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 294/627] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:09 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:10.623491 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:10.624054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:10.639580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:10.640296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:10.641278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:10.642080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:11.169381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:11.185445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3558b326-c785-4fc6-8d2c-27f20a1a38f0 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.566325 Jul 06 15:29:11.199697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 334/628] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:10 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:11.232712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b9abd092-88c8-4444-9349-4d77d2795fd9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: .version_select at 0x7f449c6d1b80>, body: {"keypair": {"name": "tempest-keypair-1266623106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6U58hOtAp1I/szPzLvvKvF9rDZl+IC0/QBWtjPQqgWeeLzTKbTEdcI8dJ0nbymhlrxvwRuuRXEseZcAYZXlaSmN59LNTxNfR7C++sD7Tj9WyaF6Ah509CzIvQkm5ftHA=="}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:11.269000 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-b9abd092-88c8-4444-9349-4d77d2795fd9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:29:11.282024 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-b9abd092-88c8-4444-9349-4d77d2795fd9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:29:11.317297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:11.318147 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:11.328623 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:11.329340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:11.330277 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:11.331359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:11.345347 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b9abd092-88c8-4444-9349-4d77d2795fd9 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116582 Jul 06 15:29:11.346012 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 295/629] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:29:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:11.649794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:11.659814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-60055296-7927-4286-a02f-943f7141e210 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.350435 Jul 06 15:29:11.660578 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 335/630] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:11 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:12.205016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:12.205712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:12.217120 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:12.219790 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:12.220676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:12.221199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:12.535723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:12.546336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4241630d-9918-436d-909e-6b0a98e601e1 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1758 microversion: 2.1 time: 0.345307 Jul 06 15:29:12.554020 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 296/631] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:12 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1758 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:12.680613 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:12.689539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:12.701399 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:12.701751 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:12.704607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:12.705394 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:12.985097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:12.994580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-41d9f940-f8cc-4730-9078-bd7c6cdcd7e6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.320395 Jul 06 15:29:12.995704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 336/632] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:12 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:13.282808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-504651637", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5"}], "security_groups": [{"name": "tempest-securitygroup--1162646137"}], "key_name": "tempest-keypair-1266623106", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:13.370063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0bb416f7-04b6-4457-8854-25d0f506496f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Action: 'create', calling method: .version_select at 0x7f449c324f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1050729177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNptXYHmCq7W4wsDtwkfo50VH3skgypDikQzKAXN4wGxIUdv7phn8Q25eJm31cbcJHK5czS2UXNJeXl//QVg+oCCgC644xp1i+I8nwXhl0ac/GAiZI3v9UksXmdhAy9zrA=="}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:13.384472 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-0bb416f7-04b6-4457-8854-25d0f506496f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Getting quotas for project 42279c5b622c47a192c529ce53566555. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:29:13.388183 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-0bb416f7-04b6-4457-8854-25d0f506496f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Getting quotas for user f8ae63f0fa9e4c9ab82d46d6d24d22e3 and project 42279c5b622c47a192c529ce53566555. Resources: {'key_pairs'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:29:13.398151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] validate_networks() for [('a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:29:13.412521 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0bb416f7-04b6-4457-8854-25d0f506496f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262005 Jul 06 15:29:13.413147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 297/633] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:29:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:13.571480 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:13.572093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:13.581703 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:13.582370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:13.583364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:13.584104 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:13.796212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:13.803539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:29:13.804613 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:29:13.805305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:29:13.805806 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:29:13.806968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:29:13.810234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2fcac896-d216-4a0e-8402-cbe4861d6494 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1761 microversion: 2.1 time: 0.243155 Jul 06 15:29:13.811886 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 298/634] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:13 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1761 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:13.827499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:13.828020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:13.828889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:13.829392 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:13.847056 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:29:13.851748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:29:13.863863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:29:13.866312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:29:13.924688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eecc1e99-574b-41de-a4d9-cdcc5946ce25 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.646042 Jul 06 15:29:13.927370 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 337/635] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:29:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:29:13.936880 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-21632643-07fa-4f65-ab6f-a6318e45a723 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:13.937966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-21632643-07fa-4f65-ab6f-a6318e45a723 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:14.011327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:14.011936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:14.018406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:14.018838 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:14.019633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:14.020061 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:14.021004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-21632643-07fa-4f65-ab6f-a6318e45a723 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:14.030406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-21632643-07fa-4f65-ab6f-a6318e45a723 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1241 microversion: 2.1 time: 0.098334 Jul 06 15:29:14.031030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 299/636] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:13 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:14.192343 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:14.203688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c564cbdb-016c-472a-8657-297b96b30966 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.196094 Jul 06 15:29:14.215457 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 338/637] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:14 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:15.048519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:15.049131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:15.062133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:15.062593 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:15.063601 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:15.063836 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:15.180233 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:15.200398 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4f1b1f1d-8500-4e7a-a9a0-c56d64f623b7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1293 microversion: 2.1 time: 0.154673 Jul 06 15:29:15.202406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 300/638] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:15 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:15.221451 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:15.221980 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:15.235988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:15.236614 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:15.244377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:15.245262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:15.486063 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:15.501612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-285351ba-ddb7-4076-a2f0-6d92f8386c09 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.283776 Jul 06 15:29:15.502221 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 339/639] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:15 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:16.220478 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:16.221143 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:16.228381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:16.229081 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:16.229756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:16.230200 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:16.421332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:16.430959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-aa1614a4-a3ca-4da7-b560-94c190920c98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.214655 Jul 06 15:29:16.431700 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 301/640] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:16 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:16.520924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:16.521691 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:16.529052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:16.529793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:16.530787 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:16.531344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:16.674416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:16.683157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f95eaf27-985b-4a4a-bb68-fe6d413bbc5c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.167687 Jul 06 15:29:16.683793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 340/641] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:16 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:17.451151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:17.451959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:17.459014 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:17.459557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:17.460579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:17.460915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:17.681167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-ed2db2c5-5f11-43b6-897c-8abc8ae34333 req-9a35a5eb-4de3-49e5-b365-8fcccf7c5baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0889d118-1916-42f5-907d-37457f8ac6c0", "tag": "38f83667-978a-48ec-a53c-597a402f9348"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:17.687115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:17.691845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ed2db2c5-5f11-43b6-897c-8abc8ae34333 req-9a35a5eb-4de3-49e5-b365-8fcccf7c5baa service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:17.692328 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ed2db2c5-5f11-43b6-897c-8abc8ae34333 req-9a35a5eb-4de3-49e5-b365-8fcccf7c5baa service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:17.696932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-276dd6ac-922c-44ea-9c4e-3b3798f6c556 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.249817 Jul 06 15:29:17.697525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 302/642] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:17 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:17.702969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:17.703959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:17.707731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-ed2db2c5-5f11-43b6-897c-8abc8ae34333 req-9a35a5eb-4de3-49e5-b365-8fcccf7c5baa service nova] Creating event network-changed:38f83667-978a-48ec-a53c-597a402f9348 for instance 0889d118-1916-42f5-907d-37457f8ac6c0 on hv-cinder-84884 Jul 06 15:29:17.713295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-ed2db2c5-5f11-43b6-897c-8abc8ae34333 req-9a35a5eb-4de3-49e5-b365-8fcccf7c5baa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036253 Jul 06 15:29:17.714857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 341/643] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:17.718093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:17.718646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:17.719507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:17.719952 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:17.856222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:17.864098 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-76ea6a52-88f2-4802-84a8-07b492a8a651 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1735 microversion: 2.1 time: 0.165493 Jul 06 15:29:17.864657 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 303/644] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:17 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:18.714831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:18.715554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:18.721636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:18.722074 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:18.722827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:18.723286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:18.868971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:18.877519 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-edb985dc-2424-4267-aa92-630204778b41 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.167284 Jul 06 15:29:18.878359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 342/645] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:18 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:18.882575 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:18.883201 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:18.889682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:18.890141 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:18.891270 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:18.891765 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.069915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:19.077756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-13d676b0-31b8-4505-9bc1-a7155d174090 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1715 microversion: 2.1 time: 0.199911 Jul 06 15:29:19.078328 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 304/646] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:18 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1715 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:19.187554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:19.188048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:19.193894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.194399 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.195163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.195621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.279874 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] HTTP exception thrown: Cannot 'detach_volume' instance 3dc848c1-1535-4024-a792-3e74e6581844 while it is in vm_state rescued Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Request method failure captured: Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments/8b80a963-7a56-4bc9-b9ae-471da0a72d7e HTTP/1.1 Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalBpvBuBv4BaUaE2m0dDEyN5geTRYSJ2dfrrriheFGSIcjVDc3BdnqUpo-etU0q4BL1qGBxJ3juKDk0BwvOUgiHlbEZn_ean40sW0BMwimYVmDIedVne_OtGoTj_WQXnyPNne-4hDkByV9vivPwdae00JsdoOao1E5IP7WdlFuzSRw Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:29:19.281479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 46896be59b73481287235aac3d630f4e Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:29:19.283122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Cannot 'detach_volume' instance 3dc848c1-1535-4024-a792-3e74e6581844 while it is in vm_state rescued Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'server_id': '3dc848c1-1535-4024-a792-3e74e6581844', 'id': '8b80a963-7a56-4bc9-b9ae-471da0a72d7e'} Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3dc848c1-1535-4024-a792-3e74e6581844 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:29:19.283966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3dc848c1-1535-4024-a792-3e74e6581844 while it is in vm_state rescued Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3dc848c1-1535-4024-a792-3e74e6581844 while it is in vm_state rescued Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:19.285426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Returning 409 to user: Cannot 'detach_volume' instance 3dc848c1-1535-4024-a792-3e74e6581844 while it is in vm_state rescued {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:29:19.286609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f763798e-e932-4f21-8218-890af0bacd1a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments/8b80a963-7a56-4bc9-b9ae-471da0a72d7e" status: 409 len: 152 microversion: 2.1 time: 0.099381 Jul 06 15:29:19.286609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 343/647] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:29:19 2022] DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments/8b80a963-7a56-4bc9-b9ae-471da0a72d7e => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 06 15:29:19.292494 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:19.293034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:19.299018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.299531 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.300287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.300720 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.370606 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dc9edb63-bbef-4131-b609-c7eb746d12ed tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "POST /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/action" status: 202 len: 0 microversion: 2.1 time: 0.082407 Jul 06 15:29:19.372972 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 305/648] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:29:19 2022] POST /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:29:19.379517 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:19.380141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:19.387065 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.387553 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.388315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.388754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.518516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:19.527239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-40756984-e1e5-4550-ba3d-19dc584fe53a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1723 microversion: 2.1 time: 0.151394 Jul 06 15:29:19.527821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 344/649] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:19 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:19.895732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:19.896455 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:19.903532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.903976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:19.904724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:19.905156 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:20.035487 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:20.042851 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c4dcdb38-94fd-4014-8894-a639d4cd410b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.151848 Jul 06 15:29:20.043437 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 306/650] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:19 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:20.545088 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:20.545854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:20.552667 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:20.553125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:20.553891 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:20.554981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:20.688542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:20.696505 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-125b1b37-5cb8-47e8-ae2b-69a3db9f5dfe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1723 microversion: 2.1 time: 0.155322 Jul 06 15:29:20.697072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 345/651] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:20 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:21.059395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:21.060178 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:21.066555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:21.067111 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:21.067994 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:21.068496 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:21.207799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:21.216454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-49848248-82bc-49ac-b80c-ffb43028e42b tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.160974 Jul 06 15:29:21.217028 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 307/652] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:21 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:21.713794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:21.714383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:21.720762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:21.721206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:21.721953 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:21.722377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:21.851724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:21.855181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:21.860466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8fae8b2f-d330-4a9b-b681-51643e2cd3bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1723 microversion: 2.1 time: 0.150505 Jul 06 15:29:21.861030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 346/653] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:21 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:22.232846 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:22.233459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:22.240036 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:22.240494 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:22.241288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:22.241724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:22.373041 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:22.380439 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-54d5e31c-bca9-463d-82af-518c208a4b9e tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.151495 Jul 06 15:29:22.381030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 308/654] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:22 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:22.878163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:22.878721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:22.885581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:22.886033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:22.886789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:22.887244 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:23.019642 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:23.028619 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b8bc5b6e-629a-49c6-9a3d-a05a9748c20f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1723 microversion: 2.1 time: 0.154591 Jul 06 15:29:23.029203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 347/655] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:22 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:23.397895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:23.398541 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:23.406552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:23.407001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:23.407799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:23.408234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:23.549131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:23.557069 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5f87a0fb-f7c8-44a9-882b-fe3bb9f9dd66 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.163722 Jul 06 15:29:23.557634 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 309/656] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:23 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:24.045662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:24.046313 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:24.048263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:24.049054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:24.057177 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:24.057625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:24.058402 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:24.058836 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:24.192218 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:24.202730 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f5ce7a02-67c6-4c16-aa47-41d7668eb403 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1729 microversion: 2.1 time: 0.161022 Jul 06 15:29:24.203316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 348/657] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:24 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:24.218783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:24.219299 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:24.221220 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=10 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:24.226530 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:24.226976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:24.227785 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:24.228222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:24.247770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:24.310610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6d0689fd-4040-4f9a-8912-dac5d785b358 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095574 Jul 06 15:29:24.311211 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 310/658] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:29:24 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:24.573722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:24.574476 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:24.580966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:24.581408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:24.582183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:24.582611 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:24.728822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:24.736404 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0f81c2fb-b426-4913-92ba-6526c99a8b0a tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.166469 Jul 06 15:29:24.736917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 349/659] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:24 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:25.143740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-8126124d-20a2-4b11-b918-c76a052893a6 req-388a2e49-4b6d-4f1d-a140-8747bdae9a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0889d118-1916-42f5-907d-37457f8ac6c0", "name": "network-vif-plugged", "status": "completed", "tag": "38f83667-978a-48ec-a53c-597a402f9348"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:25.153198 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-8126124d-20a2-4b11-b918-c76a052893a6 req-388a2e49-4b6d-4f1d-a140-8747bdae9a42 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:25.153698 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-8126124d-20a2-4b11-b918-c76a052893a6 req-388a2e49-4b6d-4f1d-a140-8747bdae9a42 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:25.166614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-8126124d-20a2-4b11-b918-c76a052893a6 req-388a2e49-4b6d-4f1d-a140-8747bdae9a42 service nova] Creating event network-vif-plugged:38f83667-978a-48ec-a53c-597a402f9348 for instance 0889d118-1916-42f5-907d-37457f8ac6c0 on hv-cinder-84884 Jul 06 15:29:25.172500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-8126124d-20a2-4b11-b918-c76a052893a6 req-388a2e49-4b6d-4f1d-a140-8747bdae9a42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032663 Jul 06 15:29:25.173407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 311/660] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:25.241038 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-05ff2d38-1b50-4233-a5ca-8e2b24d29f66 req-46c3bb6d-d245-4759-bd45-59b440cd3470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc848c1-1535-4024-a792-3e74e6581844", "tag": "c1b8dfba-8c84-435a-984a-2a26f587b26e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:25.261450 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-05ff2d38-1b50-4233-a5ca-8e2b24d29f66 req-46c3bb6d-d245-4759-bd45-59b440cd3470 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:25.261894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-05ff2d38-1b50-4233-a5ca-8e2b24d29f66 req-46c3bb6d-d245-4759-bd45-59b440cd3470 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:25.279861 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-05ff2d38-1b50-4233-a5ca-8e2b24d29f66 req-46c3bb6d-d245-4759-bd45-59b440cd3470 service nova] Creating event network-changed:c1b8dfba-8c84-435a-984a-2a26f587b26e for instance 3dc848c1-1535-4024-a792-3e74e6581844 on hv-cinder-84884 Jul 06 15:29:25.291376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-05ff2d38-1b50-4233-a5ca-8e2b24d29f66 req-46c3bb6d-d245-4759-bd45-59b440cd3470 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054428 Jul 06 15:29:25.292098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 350/661] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:25.754743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:25.755488 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:25.762640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:25.763090 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:25.763890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:25.764329 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:25.969721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:25.978018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bae45e27-d804-42d1-a3a3-3dc3251fda16 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.228818 Jul 06 15:29:25.978595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 312/662] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:25 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:26.995845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:26.996542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:27.002683 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:27.003130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:27.003910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:27.004344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:27.134723 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:27.142131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b8d40629-6d97-491d-ac23-8b082daf84a3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1367 microversion: 2.1 time: 0.150988 Jul 06 15:29:27.142690 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 351/663] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:26 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:27.305625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-c32dfb67-c0d9-44df-8312-8ae34ce4a67f req-25e0d347-42f5-495c-b791-817638caeb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc848c1-1535-4024-a792-3e74e6581844", "tag": "c1b8dfba-8c84-435a-984a-2a26f587b26e"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:27.314412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-c32dfb67-c0d9-44df-8312-8ae34ce4a67f req-25e0d347-42f5-495c-b791-817638caeb45 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:27.314890 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-c32dfb67-c0d9-44df-8312-8ae34ce4a67f req-25e0d347-42f5-495c-b791-817638caeb45 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:27.326248 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-c32dfb67-c0d9-44df-8312-8ae34ce4a67f req-25e0d347-42f5-495c-b791-817638caeb45 service nova] Creating event network-changed:c1b8dfba-8c84-435a-984a-2a26f587b26e for instance 3dc848c1-1535-4024-a792-3e74e6581844 on hv-cinder-84884 Jul 06 15:29:27.331340 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-c32dfb67-c0d9-44df-8312-8ae34ce4a67f req-25e0d347-42f5-495c-b791-817638caeb45 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029349 Jul 06 15:29:27.332562 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 313/664] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:28.158846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:28.159493 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:28.166231 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:28.166682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:28.167477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:28.167917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:28.294723 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:28.302153 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6d64b21d-ca5e-4e02-8914-5f1fd4b46721 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1556 microversion: 2.1 time: 0.147205 Jul 06 15:29:28.302724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 352/665] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:28 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:28.318449 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:28.319025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:28.326303 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:28.326742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:28.327515 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:28.327944 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:28.404823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-45fc1b82-1e16-470b-b04c-e4da00262a15 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090517 Jul 06 15:29:28.405410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 314/666] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:29:28 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:29.566098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-a8681e12-12b7-4079-a3ed-90df74d3919f req-117d7177-8ff1-49ab-839c-5743c9ea2207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0889d118-1916-42f5-907d-37457f8ac6c0", "tag": "38f83667-978a-48ec-a53c-597a402f9348"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:29.574596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a8681e12-12b7-4079-a3ed-90df74d3919f req-117d7177-8ff1-49ab-839c-5743c9ea2207 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:29.575038 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a8681e12-12b7-4079-a3ed-90df74d3919f req-117d7177-8ff1-49ab-839c-5743c9ea2207 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:29.585624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-a8681e12-12b7-4079-a3ed-90df74d3919f req-117d7177-8ff1-49ab-839c-5743c9ea2207 service nova] Creating event network-changed:38f83667-978a-48ec-a53c-597a402f9348 for instance 0889d118-1916-42f5-907d-37457f8ac6c0 on hv-cinder-84884 Jul 06 15:29:29.590394 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-a8681e12-12b7-4079-a3ed-90df74d3919f req-117d7177-8ff1-49ab-839c-5743c9ea2207 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028200 Jul 06 15:29:29.590985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 353/667] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:31.008077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-292967938", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1050729177", "security_groups": [{"name": "tempest-secgroup-smoke-1771226619"}], "networks": [{"uuid": "9096fa59-64b3-483c-b50a-082ce5ce747d"}], "block_device_mapping_v2": [{"uuid": "c41a77b6-bbbe-43a8-9766-ff7604334ec5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:31.115846 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] validate_networks() for [('9096fa59-64b3-483c-b50a-082ce5ce747d', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:29:31.480690 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:29:31.481102 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:29:31.481576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:29:31.481999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:29:31.482405 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:29:31.491805 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:31.492247 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:31.493035 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:31.493466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:31.509212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Getting quotas for project 42279c5b622c47a192c529ce53566555. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:29:31.511346 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:31.513713 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Getting quotas for user f8ae63f0fa9e4c9ab82d46d6d24d22e3 and project 42279c5b622c47a192c529ce53566555. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:29:31.571710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:29:31.573778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c41a77b6-bbbe-43a8-9766-ff7604334ec5',volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:29:31.696999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e30dc824-f616-43d6-8b1b-961fd03bfc19 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693868 Jul 06 15:29:31.697680 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 315/668] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:29:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:29:31.708921 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-52c25103-9706-47a2-863f-f1c62eba7b8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:31.709617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-52c25103-9706-47a2-863f-f1c62eba7b8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:31.773321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-52c25103-9706-47a2-863f-f1c62eba7b8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:31.780957 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-52c25103-9706-47a2-863f-f1c62eba7b8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1088 microversion: 2.1 time: 0.076746 Jul 06 15:29:31.781542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 354/669] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:31 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:32.797757 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:32.798372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:32.806130 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:32.806577 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:32.807381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:32.807819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:32.888231 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:32.895702 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4632829a-2109-4e42-aca8-4bdef718ddfd tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1204 microversion: 2.1 time: 0.101655 Jul 06 15:29:32.896820 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 316/670] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:32 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:33.914391 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:33.915083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:33.917840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:33.924014 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:33.924462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:33.925296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:33.925744 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:34.110793 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-e29f8e68-fcd8-43d4-9066-761f75582d65 req-4ada7ba9-ab88-4a73-831b-b55994b67f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:34.129224 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-e29f8e68-fcd8-43d4-9066-761f75582d65 req-4ada7ba9-ab88-4a73-831b-b55994b67f3e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:34.129676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-e29f8e68-fcd8-43d4-9066-761f75582d65 req-4ada7ba9-ab88-4a73-831b-b55994b67f3e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:34.158976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-e29f8e68-fcd8-43d4-9066-761f75582d65 req-4ada7ba9-ab88-4a73-831b-b55994b67f3e service nova] Creating event network-changed:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:29:34.165538 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-e29f8e68-fcd8-43d4-9066-761f75582d65 req-4ada7ba9-ab88-4a73-831b-b55994b67f3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058154 Jul 06 15:29:34.166736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 317/671] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:34.291709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:34.299098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-703696da-3d44-4f6c-9dcc-fa230615a8d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.389221 Jul 06 15:29:34.299710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 355/672] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:33 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:35.317487 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:35.318206 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:35.325515 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:35.325968 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:35.326733 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:35.327166 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:35.530599 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:35.538157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-21777369-94d3-44db-ac76-b2dd04a18f9b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.224913 Jul 06 15:29:35.538727 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 318/673] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:35 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:36.554877 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:36.555523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:36.561505 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:36.561951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:36.562702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:36.563132 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:36.780849 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:36.788918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e69a26ed-f6f8-45bd-9f6c-718510e5b96b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.238029 Jul 06 15:29:36.789488 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 356/674] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:36 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:37.805742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:37.806353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:37.813001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:37.813468 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:37.814251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:37.814677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:37.993631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:38.000974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-47e4bd6d-97bc-413d-9ceb-e0adc116f8c2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.199105 Jul 06 15:29:38.001533 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 319/675] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:37 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:39.018154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:39.018763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:39.025851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:39.026297 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:39.027349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:39.027781 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:39.160181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:39.168235 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7304367c-172e-480d-8dc8-78d4a02c0c5c tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.153952 Jul 06 15:29:39.168793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 357/676] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:39 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:40.184778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:40.185388 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:40.191868 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:40.192314 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:40.193069 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:40.193498 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:40.322434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:40.329735 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-60b7685d-7690-463c-85f7-8e660fb2424e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.148890 Jul 06 15:29:40.330299 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 320/677] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:40 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:41.346966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:41.347605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:41.354732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:41.355176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:41.355963 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:41.356389 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:41.481018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:41.488420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0e5a5ff0-129b-4d63-b94c-a9cc93fdfcaf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.145319 Jul 06 15:29:41.488989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 358/678] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:41 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:42.505488 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:42.506112 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:42.508981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:42.509618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=6 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:42.515147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:42.515610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:42.516353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:42.516784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:42.648276 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:42.655783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-580cd107-0bbd-49a3-b27b-1546f8671e53 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.154156 Jul 06 15:29:42.656342 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 321/679] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:42 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:43.672392 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:43.672994 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:43.674840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:43.681716 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:43.682157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:43.682926 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:43.683383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:43.817218 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:43.824842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ca3a3a14-4872-478d-98ea-c9bae56babd9 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.156213 Jul 06 15:29:43.825610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 359/680] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:43 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:44.841899 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:44.842437 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:44.849184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:44.849652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:44.850427 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:44.850865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:44.979349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:44.986718 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fd0b0534-1a5e-4ce8-a6f0-ffa9b4ac5486 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.148928 Jul 06 15:29:44.987300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 322/681] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:44 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:45.169059 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:45.169996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:45.176552 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.177057 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.177819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.178733 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.208498 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9ee5ab87-a39f-4fc9-a6c9-6d9f875c5669 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043417 Jul 06 15:29:45.209080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 360/682] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:29:45 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:29:45.230147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-5899ac61-7904-4801-90c8-d01d4f9f25a8 req-b7f40ba1-bf34-4b13-8647-4f504cbd6d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "name": "network-vif-plugged", "status": "completed", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:45.247102 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5899ac61-7904-4801-90c8-d01d4f9f25a8 req-b7f40ba1-bf34-4b13-8647-4f504cbd6d74 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.247585 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5899ac61-7904-4801-90c8-d01d4f9f25a8 req-b7f40ba1-bf34-4b13-8647-4f504cbd6d74 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.266076 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-5899ac61-7904-4801-90c8-d01d4f9f25a8 req-b7f40ba1-bf34-4b13-8647-4f504cbd6d74 service nova] Creating event network-vif-plugged:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:29:45.266630 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-5899ac61-7904-4801-90c8-d01d4f9f25a8 req-b7f40ba1-bf34-4b13-8647-4f504cbd6d74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041819 Jul 06 15:29:45.267621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 323/683] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:45.276828 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:45.277329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:45.284853 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.285303 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.286082 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.286518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.316304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:29:45.389705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6e2cb84a-65f8-45ea-8325-edb2cd0b293a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 204 len: 0 microversion: 2.1 time: 0.116633 Jul 06 15:29:45.390206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 361/684] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:29:45 2022] DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:29:45.399879 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:45.400588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:45.407528 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.408033 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.408805 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:45.409268 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:45.539886 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:45.547306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0d51a9eb-de4e-4b36-80fd-344ae2c63348 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1674 microversion: 2.1 time: 0.152615 Jul 06 15:29:45.547877 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 324/685] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:45 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:46.004558 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:46.005252 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:46.011699 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:46.012142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:46.012892 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:46.013325 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:46.141352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:46.148764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-74b383a9-e0b7-4f02-b79e-3a15a0edd246 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.148438 Jul 06 15:29:46.149340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 362/686] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:45 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:46.660898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:46.661514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:46.667538 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:46.667988 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:46.668774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:46.669211 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:46.793664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:46.801040 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-512d5c76-25ee-4357-bb9a-5c96c638e214 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1674 microversion: 2.1 time: 0.240512 Jul 06 15:29:46.801633 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 325/687] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:46 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:47.165526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:47.166135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:47.172589 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:47.173029 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:47.173772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:47.174203 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:47.307624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:47.314988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f96ab212-4666-4cac-adb3-b0c1934d2bae tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.153341 Jul 06 15:29:47.315590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 363/688] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:47 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:47.818473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:47.819717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:47.826696 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:47.827138 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:47.827959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:47.828410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:48.095621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:48.103251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2f3edfcc-42ee-45da-adbb-89329bf098eb tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1674 microversion: 2.1 time: 0.288898 Jul 06 15:29:48.104009 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 326/689] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:47 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1674 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:48.332270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:48.332871 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:48.339753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:48.340200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:48.340985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:48.341418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:48.345494 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:48.476225 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:48.483654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-477b02a2-f9de-4395-97e6-83758db669e3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1260 microversion: 2.1 time: 0.155154 Jul 06 15:29:48.484230 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 364/690] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:48 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:49.121612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:49.122363 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:49.130123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.130667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.132656 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.133462 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.145409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-469b6129-c202-426b-b494-2e6cba1474e9 req-7bd47050-cce2-4140-a1b8-d9160d9a9122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3811251a-a0ba-4f29-9160-96c0f3f46c52", "name": "network-vif-deleted", "tag": "fe67390d-68cb-4317-96a3-d85d3d7d6ff7"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:49.160176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-469b6129-c202-426b-b494-2e6cba1474e9 req-7bd47050-cce2-4140-a1b8-d9160d9a9122 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.160537 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-469b6129-c202-426b-b494-2e6cba1474e9 req-7bd47050-cce2-4140-a1b8-d9160d9a9122 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.181571 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-469b6129-c202-426b-b494-2e6cba1474e9 req-7bd47050-cce2-4140-a1b8-d9160d9a9122 service nova] Creating event network-vif-deleted:fe67390d-68cb-4317-96a3-d85d3d7d6ff7 for instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 on hv-cinder-84884 Jul 06 15:29:49.186235 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-469b6129-c202-426b-b494-2e6cba1474e9 req-7bd47050-cce2-4140-a1b8-d9160d9a9122 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044441 Jul 06 15:29:49.186991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 365/691] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:29:49.237166 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:49.252208 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-204b866a-7191-4882-9b1f-e7e35b5eb92b tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 200 len: 1607 microversion: 2.1 time: 0.134887 Jul 06 15:29:49.253505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 327/692] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:49 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 1607 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:49.502351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:49.503070 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:49.509949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.510460 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.511318 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.511810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.667208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:49.687633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3f61cb4c-5921-4157-ba3f-7a2b0f4dc41a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1445 microversion: 2.1 time: 0.188819 Jul 06 15:29:49.689250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 366/693] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:49 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1445 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:49.706831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:49.707852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:49.726344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.727540 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.728677 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:49.729390 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:49.889787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:49.897648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-59a12d38-43d1-42ed-9de7-08e6a83778b7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1445 microversion: 2.1 time: 0.196163 Jul 06 15:29:49.898969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 328/694] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:49 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1445 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:29:50.270300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:50.271281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:50.279200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:50.279665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:50.280665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:50.281010 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:50.295415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] HTTP exception thrown: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Request method failure captured: Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 HTTP/1.1 Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixak9F-8uYskSX4fVV7G_UzX0VUABmw4BU1YthB6Y32JhQcb6PfcK8N3F80mZzaASjOPuWkXgLx1mqql7b3FpEDYtbb3rkLN8bIAePzcckl7qh-QvimzXvRXw5oX13Kg5nF7vT60_VU74152CsCd-Qj-ON7Hkas88ncj65mKJYTTHPFY Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:29:50.297312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6707399c704e4c97939dc84df58cb39f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 0f5497ff570f4affbbd1b2f9129c24ac Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:29:50.298649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '3811251a-a0ba-4f29-9160-96c0f3f46c52'} Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:29:50.299599 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:29:50.300821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:29:50.303925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Returning 404 to user: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:29:50.304955 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4eb2720b-4b79-4669-9d60-9f27bb83abf5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 404 len: 111 microversion: 2.1 time: 0.038689 Jul 06 15:29:50.306021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 367/695] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:50 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:29:50.314131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f613550f-5e1f-42b3-b2b6-9a425e79cdbd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '.version_select at 0x7f449c4a9940>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:50.333025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f613550f-5e1f-42b3-b2b6-9a425e79cdbd tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277962341" status: 202 len: 0 microversion: 2.1 time: 0.022810 Jul 06 15:29:50.333788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 329/696] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jul 6 15:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277962341 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 15:29:50.976985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-18e8d542-ad36-44dc-bc26-77362cf495b5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: .version_select at 0x7f449d4e9430>, body: {"keypair": {"name": "tempest-keypair-853473892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj8kZb67Hc24v5AJLCHikyVpeG54FMqCeiDjEyQEJID/oG8dE2qiglARp2Fs9T9/Y9mTzLXbaQkD9PVX43LiEewJ2bcK1IFOU+fmOf9uidOgjud4XGhe2QQFTLNk2jCIQ=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:50.991002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-18e8d542-ad36-44dc-bc26-77362cf495b5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for project 6707399c704e4c97939dc84df58cb39f. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:29:50.994874 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-18e8d542-ad36-44dc-bc26-77362cf495b5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for user 0f5497ff570f4affbbd1b2f9129c24ac and project 6707399c704e4c97939dc84df58cb39f. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:29:51.016693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-18e8d542-ad36-44dc-bc26-77362cf495b5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044218 Jul 06 15:29:51.017290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 368/697] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:29:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:51.601052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-76719bb5-3655-495a-a77e-34427b8cce99 req-1f29ef35-bacd-43b5-932d-d87a1952ba27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:51.613503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-76719bb5-3655-495a-a77e-34427b8cce99 req-1f29ef35-bacd-43b5-932d-d87a1952ba27 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:51.614279 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-76719bb5-3655-495a-a77e-34427b8cce99 req-1f29ef35-bacd-43b5-932d-d87a1952ba27 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:51.626350 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-76719bb5-3655-495a-a77e-34427b8cce99 req-1f29ef35-bacd-43b5-932d-d87a1952ba27 service nova] Creating event network-changed:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:29:51.631845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-76719bb5-3655-495a-a77e-34427b8cce99 req-1f29ef35-bacd-43b5-932d-d87a1952ba27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034936 Jul 06 15:29:51.635390 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 330/698] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:52.326757 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1876562253", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3020644-2bbb-40b0-b72d-4d80a8b6cb34"}], "security_groups": [{"name": "tempest-securitygroup--416957592"}], "key_name": "tempest-keypair-853473892", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:52.432673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] validate_networks() for [('c3020644-2bbb-40b0-b72d-4d80a8b6cb34', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:29:52.841052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:29:52.841472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:29:52.841944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:29:52.842372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:29:52.842781 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:29:52.851896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:52.852337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:52.853129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:52.853559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:52.870115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for project 6707399c704e4c97939dc84df58cb39f. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:29:52.874025 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Getting quotas for user 0f5497ff570f4affbbd1b2f9129c24ac and project 6707399c704e4c97939dc84df58cb39f. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:29:52.884959 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:29:52.887183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:29:52.936989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-383b4ca5-53ea-4707-a5dd-b8b8c8af15d5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.614626 Jul 06 15:29:52.937949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 369/699] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:29:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:29:52.948804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-003bbae0-1d4b-4c6e-bdbe-2fa7b0f0745d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:52.949498 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-003bbae0-1d4b-4c6e-bdbe-2fa7b0f0745d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:53.002158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-003bbae0-1d4b-4c6e-bdbe-2fa7b0f0745d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:53.008783 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-003bbae0-1d4b-4c6e-bdbe-2fa7b0f0745d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1237 microversion: 2.1 time: 0.064681 Jul 06 15:29:53.009324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 331/700] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:52 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:54.025387 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:54.026487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:54.033914 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:54.034422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:54.035129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:54.035593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:54.096317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:54.104134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ae3f7fa8-af1e-41aa-8cff-9531052b7b81 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1295 microversion: 2.1 time: 0.083225 Jul 06 15:29:54.104694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 370/701] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:54 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:55.121584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:55.122189 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:55.130262 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:55.130713 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:55.131566 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:55.132188 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:55.136566 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=89 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:55.322329 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:55.333273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6c3ee1ae-a9df-4d18-ab5a-98055e077628 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.215326 Jul 06 15:29:55.334182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 332/702] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:55 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:55.384449 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-6f55f4d6-801a-4efd-9b1c-13a21fc6a10b req-068417a8-73ef-4ceb-b683-fb655a56af71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da295c29-c8ab-4451-8e09-c814b1288b4f", "tag": "0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:29:55.400839 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6f55f4d6-801a-4efd-9b1c-13a21fc6a10b req-068417a8-73ef-4ceb-b683-fb655a56af71 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:55.401542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6f55f4d6-801a-4efd-9b1c-13a21fc6a10b req-068417a8-73ef-4ceb-b683-fb655a56af71 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:55.414379 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-6f55f4d6-801a-4efd-9b1c-13a21fc6a10b req-068417a8-73ef-4ceb-b683-fb655a56af71 service nova] Creating event network-changed:0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8 for instance da295c29-c8ab-4451-8e09-c814b1288b4f on hv-cinder-84884 Jul 06 15:29:55.419190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-6f55f4d6-801a-4efd-9b1c-13a21fc6a10b req-068417a8-73ef-4ceb-b683-fb655a56af71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045008 Jul 06 15:29:55.419830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 371/703] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:29:56.350127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:56.351300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:56.357843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:56.358289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:56.359042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:56.359510 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:56.484472 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:56.491728 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9d5ae3d9-53ae-4ccd-a103-18b6289e6635 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.145510 Jul 06 15:29:56.492288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 333/704] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:56 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:57.509459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:57.510149 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:57.516226 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:57.516664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:57.517416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:57.517851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:57.652891 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:57.660259 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4045bcf9-3a19-4128-9d11-b2c1f477ebf0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.156119 Jul 06 15:29:57.660832 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 372/705] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:57 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:58.676969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:58.677607 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:58.684177 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:58.684620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:58.685370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:58.685801 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:58.815260 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:58.823026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d5f32121-e96b-45cb-8ca7-d419d8d8e896 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.149946 Jul 06 15:29:58.823625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 334/706] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:58 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:29:59.839617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:29:59.840222 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:29:59.846879 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:59.847363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:59.848110 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:29:59.848536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:29:59.974668 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:29:59.982934 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-be0db27a-21b0-4a09-b07a-25a8ca011a9a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.147269 Jul 06 15:29:59.983529 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 373/707] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:29:59 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:00.999427 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:01.000059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:01.006385 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:01.007437 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:01.008191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:01.008622 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:01.135247 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:01.142721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9905360a-9358-4b93-a8bb-3c62e01f4724 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.147235 Jul 06 15:30:01.143312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 335/708] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:00 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:01.300154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-33d9bda3-35ba-459e-947c-73325ada8470 req-615caf40-0ef9-45e1-a55f-c92a114ae973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da295c29-c8ab-4451-8e09-c814b1288b4f", "name": "network-vif-plugged", "status": "completed", "tag": "0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:01.309904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-33d9bda3-35ba-459e-947c-73325ada8470 req-615caf40-0ef9-45e1-a55f-c92a114ae973 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:01.310605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-33d9bda3-35ba-459e-947c-73325ada8470 req-615caf40-0ef9-45e1-a55f-c92a114ae973 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:01.323045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-33d9bda3-35ba-459e-947c-73325ada8470 req-615caf40-0ef9-45e1-a55f-c92a114ae973 service nova] Creating event network-vif-plugged:0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8 for instance da295c29-c8ab-4451-8e09-c814b1288b4f on hv-cinder-84884 Jul 06 15:30:01.328038 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-33d9bda3-35ba-459e-947c-73325ada8470 req-615caf40-0ef9-45e1-a55f-c92a114ae973 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Jul 06 15:30:01.329206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 374/709] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:02.159737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:02.160358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:02.162670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:02.168166 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:02.168612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:02.169374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:02.169811 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:02.300878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:02.308717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c64d57fd-4d21-413f-bf61-83e3d86b108e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1362 microversion: 2.1 time: 0.152846 Jul 06 15:30:02.309286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 336/710] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:02 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:03.326841 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:03.327480 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:03.329815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:03.330487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=10 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:03.337512 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:03.337954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:03.338889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:03.339486 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:03.470567 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:03.477998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3d583376-65b9-4f56-8585-baa478934db6 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1548 microversion: 2.1 time: 0.155386 Jul 06 15:30:03.478584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 375/711] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:03 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:03.493898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:03.494399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:03.496274 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:03.502244 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:03.502684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:03.503453 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:03.503883 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:03.581711 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9f5a68ed-0b10-4733-b915-5b2a20c29fbe tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091630 Jul 06 15:30:03.582334 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 337/712] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:30:03 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:04.486377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-a73a4742-63ea-4231-b7c0-add86eb428e6 req-38583827-10a0-4d10-bb8f-bd94ad16ef60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da295c29-c8ab-4451-8e09-c814b1288b4f", "tag": "0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:04.490175 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:04.496628 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a73a4742-63ea-4231-b7c0-add86eb428e6 req-38583827-10a0-4d10-bb8f-bd94ad16ef60 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:04.497065 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a73a4742-63ea-4231-b7c0-add86eb428e6 req-38583827-10a0-4d10-bb8f-bd94ad16ef60 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:04.508590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-a73a4742-63ea-4231-b7c0-add86eb428e6 req-38583827-10a0-4d10-bb8f-bd94ad16ef60 service nova] Creating event network-changed:0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8 for instance da295c29-c8ab-4451-8e09-c814b1288b4f on hv-cinder-84884 Jul 06 15:30:04.514513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-a73a4742-63ea-4231-b7c0-add86eb428e6 req-38583827-10a0-4d10-bb8f-bd94ad16ef60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031752 Jul 06 15:30:04.515100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 376/713] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:06.223694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:06.224185 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:06.230784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:06.231245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:06.231992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:06.232418 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:06.312091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'services' on Instance uuid 3dc848c1-1535-4024-a792-3e74e6581844 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:06.379674 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-49ea591f-cfe2-4fe5-b6b4-3cddc377e683 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments/8b80a963-7a56-4bc9-b9ae-471da0a72d7e" status: 202 len: 0 microversion: 2.1 time: 0.160105 Jul 06 15:30:06.380269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 338/714] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:30:06 2022] DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments/8b80a963-7a56-4bc9-b9ae-471da0a72d7e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:30:06.390079 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:06.391097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:06.398210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:06.398758 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:06.399668 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:06.400097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:06.429195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e9444e79-3817-4c89-a9fe-63080ee3576a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Jul 06 15:30:06.429762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 377/715] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:06 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:07.441926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:07.442876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:07.449279 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:07.449755 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:07.450508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:07.450943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:07.479483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-94d4ab9b-c8d2-4826-aa8c-1a3e62615c3e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042320 Jul 06 15:30:07.480033 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 339/716] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:07 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:30:07.547135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:07.547646 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:07.555445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:07.555902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:07.556754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:07.557206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:07.581683 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:30:07.653814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d8ff811c-4a56-4f31-8251-f86695041b85 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 204 len: 0 microversion: 2.1 time: 0.110232 Jul 06 15:30:07.654443 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 378/717] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:30:07 2022] DELETE /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:30:07.664204 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:07.664812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:07.670777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:07.671263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:07.672055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:07.672493 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:07.800458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:07.807904 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d7f4156e-0f16-4af9-ba5f-76c24b3a19fe tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1689 microversion: 2.1 time: 0.149207 Jul 06 15:30:07.808459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 340/718] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:07 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:08.825081 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:08.825776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:08.832128 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:08.832575 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:08.833325 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:08.833753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:08.962279 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:08.969612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f0130bc8-c612-4046-a4d2-a107bcb05886 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1689 microversion: 2.1 time: 0.148784 Jul 06 15:30:08.970187 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 379/719] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:08 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:09.986959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:09.987589 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:09.995245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:09.995706 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:09.996453 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:09.996881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:10.130278 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:10.137757 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fcdad498-e4a6-43a5-96c2-ad635c7124dd tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1689 microversion: 2.1 time: 0.154623 Jul 06 15:30:10.138320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 341/720] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:09 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:11.153965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:11.154565 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:11.161038 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:11.161480 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:11.162272 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:11.162699 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:11.293357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:11.300826 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f8da3443-ae11-4fea-b46a-3c354e1e8571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1689 microversion: 2.1 time: 0.150925 Jul 06 15:30:11.301396 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 380/721] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:11 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:12.223316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-88fbf212-711c-4154-b935-38618fb5875a req-80a26a16-01e1-4bb7-8f9c-a3b91fcacc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc848c1-1535-4024-a792-3e74e6581844", "name": "network-vif-deleted", "tag": "c1b8dfba-8c84-435a-984a-2a26f587b26e"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:12.235160 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-88fbf212-711c-4154-b935-38618fb5875a req-80a26a16-01e1-4bb7-8f9c-a3b91fcacc14 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:12.235763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-88fbf212-711c-4154-b935-38618fb5875a req-80a26a16-01e1-4bb7-8f9c-a3b91fcacc14 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:12.255085 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-88fbf212-711c-4154-b935-38618fb5875a req-80a26a16-01e1-4bb7-8f9c-a3b91fcacc14 service nova] Creating event network-vif-deleted:c1b8dfba-8c84-435a-984a-2a26f587b26e for instance 3dc848c1-1535-4024-a792-3e74e6581844 on hv-cinder-84884 Jul 06 15:30:12.260613 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-88fbf212-711c-4154-b935-38618fb5875a req-80a26a16-01e1-4bb7-8f9c-a3b91fcacc14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107120 Jul 06 15:30:12.261286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 342/722] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:12.318021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:12.319456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:12.326590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:12.327047 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:12.328023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:12.328751 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:12.363655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:12.364097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:12.364543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'fault' on Instance uuid 3dc848c1-1535-4024-a792-3e74e6581844 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:12.409377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:12.416691 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2f64535d-becc-4c92-9078-b5d90b8ffcdc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 200 len: 1335 microversion: 2.1 time: 0.102588 Jul 06 15:30:12.417275 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 381/723] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:12 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:12.942997 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:12.944264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:12.950831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:12.951299 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:12.953234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:12.953841 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:12.979130 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-db11c15f-21a9-4f04-9479-3d83647f5fc3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/ips" status: 200 len: 149 microversion: 2.1 time: 0.093027 Jul 06 15:30:12.979728 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 343/724] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:30:12 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/ips => generated 149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:13.433555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:13.434099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: 3dc848c1-1535-4024-a792-3e74e6581844] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:13.440509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:13.440949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:13.441727 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:13.442156 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:13.455131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] HTTP exception thrown: Instance 3dc848c1-1535-4024-a792-3e74e6581844 could not be found. Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Request method failure captured: Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 HTTP/1.1 Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalBpvBuBv4BaUaE2m0dDEyN5geTRYSJ2dfrrriheFGSIcjVDc3BdnqUpo-etU0q4BL1qGBxJ3juKDk0BwvOUgiHlbEZn_ean40sW0BMwimYVmDIedVne_OtGoTj_WQXnyPNne-4hDkByV9vivPwdae00JsdoOao1E5IP7WdlFuzSRw Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:30:13.456761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 46896be59b73481287235aac3d630f4e Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 3dc848c1-1535-4024-a792-3e74e6581844 could not be found. Jul 06 15:30:13.458341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '3dc848c1-1535-4024-a792-3e74e6581844'} Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc848c1-1535-4024-a792-3e74e6581844 could not be found. Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:13.459784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc848c1-1535-4024-a792-3e74e6581844 could not be found. Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc848c1-1535-4024-a792-3e74e6581844 could not be found. Jul 06 15:30:13.461022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:13.462142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Returning 404 to user: Instance 3dc848c1-1535-4024-a792-3e74e6581844 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:13.462142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b055ee30-432c-4e36-ab42-c17962cf762a tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844" status: 404 len: 111 microversion: 2.1 time: 0.028573 Jul 06 15:30:13.462142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 382/725] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:13 2022] GET /compute/v2.1/servers/3dc848c1-1535-4024-a792-3e74e6581844 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:13.467583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b6a994ac-5061-4f2c-81b7-888c59eea980 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '.version_select at 0x7f449c2331f0>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:13.485252 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b6a994ac-5061-4f2c-81b7-888c59eea980 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866355635" status: 202 len: 0 microversion: 2.1 time: 0.021899 Jul 06 15:30:13.485818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 344/726] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jul 6 15:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866355635 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 15:30:14.308958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc0db547-b4d6-41fa-9e4d-ba9a518f5690"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:14.310025 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:14.316596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:14.317048 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:14.317810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:14.318242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:14.531664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:14.551101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f652b4c5-749e-4f89-acd0-89414e410c24 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246193 Jul 06 15:30:14.551936 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 383/727] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:30:14 2022] POST /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:16.348410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:16.348903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:16.355196 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:16.355673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:16.356454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:16.356888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:16.381881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Going to try to terminate instance {{(pid=117620) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:30:16.455675 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b166a8d2-0fda-49d6-9896-d981d212a801 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 204 len: 0 microversion: 2.1 time: 0.111040 Jul 06 15:30:16.456452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 345/728] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:30:16 2022] DELETE /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:30:16.466412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:16.467287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:16.473530 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:16.473974 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:16.475378 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:16.475819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:16.603796 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:16.611066 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-552150bd-8925-4ceb-b785-4f9ce80bb2df tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1509 microversion: 2.1 time: 0.149430 Jul 06 15:30:16.612477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 384/729] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:16 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:17.433743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1808262137"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:17.434353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:17.440691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:17.441133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:17.441878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:17.442307 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:17.566918 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.network.security_group_api [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Removing security group 5fee6c02-3f56-4a46-8ff0-68420d1be68a from port 06b84364-8b0e-41bc-bdb2-0e28411c93d0 Jul 06 15:30:17.629247 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:17.629966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:17.636901 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:17.637357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:17.638119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:17.638554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:17.770549 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:17.780586 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9bd3455b-f9f5-4fb9-bf23-4ce7528ed58d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1509 microversion: 2.1 time: 0.155183 Jul 06 15:30:17.781813 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 385/730] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:17 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:17.912438 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9d754109-ca6c-4451-84df-2146be037ac5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/action" status: 202 len: 0 microversion: 2.1 time: 0.482772 Jul 06 15:30:17.916213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 346/731] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:30:17 2022] POST /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:30:17.931884 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-48168514-7165-4cce-96bb-5515445868ec req-4204d20a-edf0-4de4-b2c0-780de75ed184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:17.946435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-48168514-7165-4cce-96bb-5515445868ec req-4204d20a-edf0-4de4-b2c0-780de75ed184 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:17.947032 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-48168514-7165-4cce-96bb-5515445868ec req-4204d20a-edf0-4de4-b2c0-780de75ed184 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:17.967159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-48168514-7165-4cce-96bb-5515445868ec req-4204d20a-edf0-4de4-b2c0-780de75ed184 service nova] Creating event network-changed:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:30:17.973991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-48168514-7165-4cce-96bb-5515445868ec req-4204d20a-edf0-4de4-b2c0-780de75ed184 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045422 Jul 06 15:30:17.974900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 386/732] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:18.798237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:18.799046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:18.805348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:18.805873 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:18.806716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:18.807226 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:19.215169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:19.222629 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6359fc4a-f47f-4df5-b778-5b8f1476ad6d tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1509 microversion: 2.1 time: 0.428697 Jul 06 15:30:19.223192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 347/733] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:18 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:19.968482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:19.969634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:19.979434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:19.979868 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:19.980635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:19.981065 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:19.992501 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-4281f9e3-efb1-4b49-8d37-0340c9fc83e1 req-f0826edf-bfa0-488e-adbb-d6e88f210691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:20.009548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-4281f9e3-efb1-4b49-8d37-0340c9fc83e1 req-f0826edf-bfa0-488e-adbb-d6e88f210691 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:20.010184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-4281f9e3-efb1-4b49-8d37-0340c9fc83e1 req-f0826edf-bfa0-488e-adbb-d6e88f210691 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:20.035571 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-4281f9e3-efb1-4b49-8d37-0340c9fc83e1 req-f0826edf-bfa0-488e-adbb-d6e88f210691 service nova] Creating event network-changed:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:30:20.056796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-4281f9e3-efb1-4b49-8d37-0340c9fc83e1 req-f0826edf-bfa0-488e-adbb-d6e88f210691 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068534 Jul 06 15:30:20.059089 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 348/734] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:20.171346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lazy-loading 'services' on Instance uuid f08c8b7f-24e0-47fe-9b46-87202f357774 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:20.239973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:20.240973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:20.258230 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:20.260164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:20.261110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:20.266732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:20.315250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5472bc9e-48c6-439a-8942-0cc4b5ca3654 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments/e7d4e6cf-298d-449f-bafc-1e50c60a4c73" status: 202 len: 0 microversion: 2.1 time: 0.351332 Jul 06 15:30:20.320164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 387/735] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:30:19 2022] DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments/e7d4e6cf-298d-449f-bafc-1e50c60a4c73 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:30:20.326433 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:20.328454 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:20.336176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:20.336909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:20.337902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:20.338541 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:20.342152 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:20.345848 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:20.351548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d6eff245-91a4-4872-92e0-7d32e31168fc tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1467 microversion: 2.1 time: 0.115757 Jul 06 15:30:20.352776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 349/736] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:20 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1467 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:20.374237 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ff25ab7a-d886-4278-9df3-b7456b24dc05 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052437 Jul 06 15:30:20.375000 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 388/737] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:20 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:21.369709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:21.370253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:21.377463 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:21.377917 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:21.378678 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:21.379115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:21.387420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:21.388952 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:21.395659 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:21.396113 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:21.396881 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:21.397486 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:21.411001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:21.411483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:21.412441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'fault' on Instance uuid e00187af-8819-41e6-98f0-199ce9db0f05 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:21.438511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6e2b1058-acc3-494a-9433-3f17648e533e tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055951 Jul 06 15:30:21.439478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 389/738] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:21 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:30:21.455497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:21.463758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-cdc19b4e-02d4-4338-ad15-9d999a83a499 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 200 len: 1312 microversion: 2.1 time: 0.098897 Jul 06 15:30:21.464661 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 350/739] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:21 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:22.077814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-5c048dda-e064-49a5-9c0e-99082d58b164 req-e7709817-b933-471e-9432-adcff1abdf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00187af-8819-41e6-98f0-199ce9db0f05", "name": "network-vif-deleted", "tag": "e5ce60d9-c5f8-4326-aa01-dd12e4cd2dd6"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:22.086507 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-5c048dda-e064-49a5-9c0e-99082d58b164 req-e7709817-b933-471e-9432-adcff1abdf24 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.087046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-5c048dda-e064-49a5-9c0e-99082d58b164 req-e7709817-b933-471e-9432-adcff1abdf24 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.098979 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-5c048dda-e064-49a5-9c0e-99082d58b164 req-e7709817-b933-471e-9432-adcff1abdf24 service nova] Creating event network-vif-deleted:e5ce60d9-c5f8-4326-aa01-dd12e4cd2dd6 for instance e00187af-8819-41e6-98f0-199ce9db0f05 on hv-cinder-84884 Jul 06 15:30:22.104019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-5c048dda-e064-49a5-9c0e-99082d58b164 req-e7709817-b933-471e-9432-adcff1abdf24 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029846 Jul 06 15:30:22.104791 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 390/740] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:30:22.142022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc0db547-b4d6-41fa-9e4d-ba9a518f5690"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:22.143134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.149853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.150297 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.151343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.151777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.228988 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Invalid volume: volume dc0db547-b4d6-41fa-9e4d-ba9a518f5690 is already attached to instances: 0889d118-1916-42f5-907d-37457f8ac6c0 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: POST /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments HTTP/1.1 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 74 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:30:22.230704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {"volumeAttachment": {"volumeId": "dc0db547-b4d6-41fa-9e4d-ba9a518f5690"}} Jul 06 15:30:22.232336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Invalid volume: volume dc0db547-b4d6-41fa-9e4d-ba9a518f5690 is already attached to instances: 0889d118-1916-42f5-907d-37457f8ac6c0 Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'server_id': '0889d118-1916-42f5-907d-37457f8ac6c0', 'body': {'volumeAttachment': {'volumeId': 'dc0db547-b4d6-41fa-9e4d-ba9a518f5690'}}} Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc0db547-b4d6-41fa-9e4d-ba9a518f5690 is already attached to instances: 0889d118-1916-42f5-907d-37457f8ac6c0 Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.233129 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc0db547-b4d6-41fa-9e4d-ba9a518f5690 is already attached to instances: 0889d118-1916-42f5-907d-37457f8ac6c0 Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.234286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc0db547-b4d6-41fa-9e4d-ba9a518f5690 is already attached to instances: 0889d118-1916-42f5-907d-37457f8ac6c0 Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 400 to user: Invalid volume: volume dc0db547-b4d6-41fa-9e4d-ba9a518f5690 is already attached to instances: 0889d118-1916-42f5-907d-37457f8ac6c0 {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5b208b5b-4773-4f83-b080-4fa8f4dd7565 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094310 Jul 06 15:30:22.235500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 351/741] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:30:22 2022] POST /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:30:22.293364 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.293961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.300158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.300607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.301366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.301804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.380194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lazy-loading 'services' on Instance uuid 0889d118-1916-42f5-907d-37457f8ac6c0 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:22.450715 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.451794 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.451913 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c83bd5d5-0d03-455d-a964-5a5752b350b4 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments/dc0db547-b4d6-41fa-9e4d-ba9a518f5690" status: 202 len: 0 microversion: 2.1 time: 0.162647 Jul 06 15:30:22.452545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 391/742] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:30:22 2022] DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments/dc0db547-b4d6-41fa-9e4d-ba9a518f5690 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:30:22.462026 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.462616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.463063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.463741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.463863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.464271 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.471353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.471799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.472565 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.473612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.494709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-690360b3-0631-4f08-b6e0-777d99a49e01 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047761 Jul 06 15:30:22.495384 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 352/743] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:22 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 06 15:30:22.499823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.503120 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: e00187af-8819-41e6-98f0-199ce9db0f05] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.510419 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.510892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.511536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-40a2407d-c16c-4b0a-9799-dc2528997251 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054097 Jul 06 15:30:22.511675 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.512115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.512265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 392/744] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:22 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:30:22.517083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.518163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.525774 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.526423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.528117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.528235 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] HTTP exception thrown: Instance e00187af-8819-41e6-98f0-199ce9db0f05 could not be found. Jul 06 15:30:22.528868 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Request method failure captured: Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 HTTP/1.1 Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalBpvBuBv4BaUaE2m0dDEyN5geTRYSJ2dfrrriheFGSIcjVDc3BdnqUpo-etU0q4BL1qGBxJ3juKDk0BwvOUgiHlbEZn_ean40sW0BMwimYVmDIedVne_OtGoTj_WQXnyPNne-4hDkByV9vivPwdae00JsdoOao1E5IP7WdlFuzSRw Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:30:22.529665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 46896be59b73481287235aac3d630f4e Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance e00187af-8819-41e6-98f0-199ce9db0f05 could not be found. Jul 06 15:30:22.530948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'e00187af-8819-41e6-98f0-199ce9db0f05'} Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00187af-8819-41e6-98f0-199ce9db0f05 could not be found. Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:22.531752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00187af-8819-41e6-98f0-199ce9db0f05 could not be found. Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00187af-8819-41e6-98f0-199ce9db0f05 could not be found. Jul 06 15:30:22.532925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.534031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Returning 404 to user: Instance e00187af-8819-41e6-98f0-199ce9db0f05 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:22.534031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-74c652f8-b412-4668-b6ba-115fbaa25bab tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05" status: 404 len: 111 microversion: 2.1 time: 0.034700 Jul 06 15:30:22.534031 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 353/745] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:22 2022] GET /compute/v2.1/servers/e00187af-8819-41e6-98f0-199ce9db0f05 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:22.542934 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.543603 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.549733 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.550253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.551124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.551711 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.577769 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Going to try to terminate instance {{(pid=117620) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:30:22.617155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] HTTP exception thrown: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 is not attached to volume e7d4e6cf-298d-449f-bafc-1e50c60a4c73 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Request method failure captured: Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments/e7d4e6cf-298d-449f-bafc-1e50c60a4c73 HTTP/1.1 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixamnb-fSmnlus0UIT12Uo4ardc012QKsbivVfuUl_bA8h--9iPBPTMqc6psWVmacWnrg0PEJjWU6fJ-BchJHq2zplv1xBRmX3yDav220EiF9RHbyQ4IUZdBWJtwUpx4b_ILPIAIMaX3avi5Zn-V8x5d4f-LG8fL1JBVULUH-Fg57sGc Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 0805ca8c35a34d0dbf0f1e7ac459c517 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestMinimumBasicScenario-644305013 Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:30:22.619632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestMinimumBasicScenario-644305013 Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 0805ca8c35a34d0dbf0f1e7ac459c517 Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestMinimumBasicScenario-644305013 Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-TestMinimumBasicScenario-644305013-project Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: b57356f7b4e748438b89d69663bb99ee Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestMinimumBasicScenario-644305013-project Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:30:22.621007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 is not attached to volume e7d4e6cf-298d-449f-bafc-1e50c60a4c73 Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'server_id': 'f08c8b7f-24e0-47fe-9b46-87202f357774', 'id': 'e7d4e6cf-298d-449f-bafc-1e50c60a4c73'} Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e7d4e6cf-298d-449f-bafc-1e50c60a4c73. Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:22.621721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 is not attached to volume e7d4e6cf-298d-449f-bafc-1e50c60a4c73 Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 is not attached to volume e7d4e6cf-298d-449f-bafc-1e50c60a4c73 Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:22.622851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Returning 404 to user: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 is not attached to volume e7d4e6cf-298d-449f-bafc-1e50c60a4c73 {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:22.623818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f5c662b8-af81-4076-933e-26f97e6c7e67 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments/e7d4e6cf-298d-449f-bafc-1e50c60a4c73" status: 404 len: 154 microversion: 2.1 time: 0.108012 Jul 06 15:30:22.623818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 393/746] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:30:22 2022] DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774/os-volume_attachments/e7d4e6cf-298d-449f-bafc-1e50c60a4c73 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:22.659059 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-53095eab-e044-40d7-af21-c856f426bc70 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 204 len: 0 microversion: 2.1 time: 0.120158 Jul 06 15:30:22.659667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 354/747] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:30:22 2022] DELETE /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 06 15:30:22.667663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:22.668359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:22.674452 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.674903 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.675707 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:22.676150 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:22.810575 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:22.817999 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-35c35d5d-deda-4c0a-83f6-eb3647db2571 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.154269 Jul 06 15:30:22.818610 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 394/748] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:22 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:23.524363 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:23.525305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:23.531961 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.532401 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.533148 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.533576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.561397 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-599e7df1-45b4-4404-b187-9a6b05d0649d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Jul 06 15:30:23.561933 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 355/749] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:23 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:23.763283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:23.763785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:23.770232 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.770678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.772027 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.772466 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.797964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:30:23.835888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:23.836535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:23.842344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.842794 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.843582 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.844010 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.870310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-10e82708-d9db-4c48-9daa-35d201c5427c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 204 len: 0 microversion: 2.1 time: 0.110518 Jul 06 15:30:23.870895 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 395/750] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:30:23 2022] DELETE /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:30:23.879240 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:23.879940 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:23.885848 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.886288 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.887040 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:23.887496 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:23.980550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:23.987894 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4da6fc4d-856c-46b3-b8f6-c301332ca06e tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.156418 Jul 06 15:30:23.988454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 356/751] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:23 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:24.021047 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:24.029202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ae824fb4-04ec-443c-afa5-d6eefed2450b tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1556 microversion: 2.1 time: 0.153908 Jul 06 15:30:24.029764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 396/752] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:23 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:24.573682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:24.574532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:24.581126 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:24.581567 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:24.582319 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:24.582747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:24.611328 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d4e068e6-5420-4287-82dc-028191094d27 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 Jul 06 15:30:24.611868 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 357/753] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:24 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:25.003738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:25.004352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:25.011467 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:25.011914 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:25.012672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:25.013103 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:25.046694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:25.047331 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:25.053888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:25.054330 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:25.055093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:25.055550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:25.142511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:25.150049 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9def9524-c8e6-43fe-9e4f-7019969a9ef6 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.150157 Jul 06 15:30:25.150888 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 397/754] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:24 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:25.203559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:25.210983 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-226d3e83-2130-4c06-9af5-cabb5909c584 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1556 microversion: 2.1 time: 0.168107 Jul 06 15:30:25.211576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 358/755] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:25 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:25.623358 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:25.624344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:25.630320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:25.630769 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:25.631626 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:25.632061 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:25.635781 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=94,nova_cell1:INSERT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:25.663144 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e7d63a66-5497-4b49-9989-d7a0f9291acc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Jul 06 15:30:25.663737 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 398/756] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:25 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:26.167690 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:26.168290 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:26.174721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:26.175160 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:26.175941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:26.176369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:26.228018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:26.228624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:26.234987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:26.235469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:26.236221 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:26.236651 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:26.306547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:26.313996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-24e17e39-e1bd-475e-ba44-3ea61dc0793c tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.150280 Jul 06 15:30:26.314570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 359/757] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:26 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:26.368654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:26.376221 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c4bc5e8a-361b-4221-8104-f58bedb2487d tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1556 microversion: 2.1 time: 0.152186 Jul 06 15:30:26.376798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 399/758] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:26 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:26.674044 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:26.675016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:26.681756 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:26.682179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:26.682929 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:26.683386 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:26.711648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3c5bd6fb-fb1d-4971-9438-d5ca37c55708 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Jul 06 15:30:26.712203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 360/759] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:26 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:27.332030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:27.332804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:27.340260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.340715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.341487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.341918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.397443 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:27.398063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:27.405431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.406153 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.406939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.407402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.480586 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:27.488399 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f9768f20-ac96-4576-a1b8-7358c962ad2f tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1522 microversion: 2.1 time: 0.160439 Jul 06 15:30:27.488992 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 400/760] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:27 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:27.723134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:27.724216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:27.731210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.731210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.731474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.731997 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.761843 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2eff456d-69b9-4302-92bd-3bb24e9d8cd0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042575 Jul 06 15:30:27.762751 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 401/761] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:27 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 06 15:30:27.765135 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:27.773571 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e0d6ce99-c021-4b17-a3b8-ad2cdc797fde tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1556 microversion: 2.1 time: 0.380573 Jul 06 15:30:27.774341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 361/762] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:27 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1556 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:27.821951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:27.822444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:27.828329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.828767 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.829539 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.829964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.856710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:30:27.933210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5813678b-ba90-43d7-8bda-87539767e346 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 204 len: 0 microversion: 2.1 time: 0.115458 Jul 06 15:30:27.933875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 402/763] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:30:27 2022] DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:30:27.944444 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:27.947515 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:27.951945 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.952387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:27.953151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:27.953579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:28.237790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-e0b62fad-6c21-4d5a-8c45-843afeb5cb98 req-ad44c69f-12f9-409e-a2a4-5362a0be4251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce440c64-f3db-4cda-8a2f-0f7e00f36b30", "name": "network-vif-deleted", "tag": "ee13c450-a247-45da-9000-1d74f1a8c8aa"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:28.246939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:28.247143 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e0b62fad-6c21-4d5a-8c45-843afeb5cb98 req-ad44c69f-12f9-409e-a2a4-5362a0be4251 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:28.247617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e0b62fad-6c21-4d5a-8c45-843afeb5cb98 req-ad44c69f-12f9-409e-a2a4-5362a0be4251 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:28.254568 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-56c1785d-1ca1-4c73-ab4c-8af2e56f5d58 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1681 microversion: 2.1 time: 0.316083 Jul 06 15:30:28.255148 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 362/764] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:27 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1681 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:28.258877 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-e0b62fad-6c21-4d5a-8c45-843afeb5cb98 req-ad44c69f-12f9-409e-a2a4-5362a0be4251 service nova] Creating event network-vif-deleted:ee13c450-a247-45da-9000-1d74f1a8c8aa for instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 on hv-cinder-84884 Jul 06 15:30:28.263710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-e0b62fad-6c21-4d5a-8c45-843afeb5cb98 req-ad44c69f-12f9-409e-a2a4-5362a0be4251 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Jul 06 15:30:28.264286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 403/765] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:30:28.505340 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:28.505946 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:28.513837 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:28.514285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:28.515127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:28.515589 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:28.585937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:28.594518 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-17f867e3-f63c-4882-a7bb-9f7c5774a8a7 tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1480 microversion: 2.1 time: 0.093006 Jul 06 15:30:28.595091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 363/766] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:28 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1480 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:28.792196 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:28.792889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:28.798984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:28.799748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:28.800236 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:28.800661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:28.861534 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:28.868939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ce5fc212-0c31-46a5-8dbf-b2a167f7274c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1514 microversion: 2.1 time: 0.081613 Jul 06 15:30:28.869509 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 404/767] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:28 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1514 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:29.271492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:29.272100 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:29.278392 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.278832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.279621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.280046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.422043 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:29.430927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-62304c79-8231-40ee-bb81-6d6327ca18b0 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1681 microversion: 2.1 time: 0.163241 Jul 06 15:30:29.431523 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 364/768] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:29 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:29.612609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:29.613162 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:29.619742 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.620194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.620951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.621384 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.649969 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.650705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.651113 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lazy-loading 'fault' on Instance uuid ce440c64-f3db-4cda-8a2f-0f7e00f36b30 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:29.691400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46896be59b73481287235aac3d630f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44ecc951964d51925463c5e09f9fbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:29.698665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c85671c5-05b6-4128-8ce6-d5b00a5108bb tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 200 len: 1312 microversion: 2.1 time: 0.089988 Jul 06 15:30:29.699251 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 405/769] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:29 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:29.885867 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:29.886404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:29.892931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.893371 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.894116 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.894543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.897630 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:29.926584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:29.927018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:29.927505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lazy-loading 'fault' on Instance uuid f08c8b7f-24e0-47fe-9b46-87202f357774 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:30:29.967062 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b57356f7b4e748438b89d69663bb99ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0805ca8c35a34d0dbf0f1e7ac459c517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:29.974937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-df8944ab-ae6f-4ca4-96f8-e103773dd93c tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 200 len: 1349 microversion: 2.1 time: 0.092463 Jul 06 15:30:29.975532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 365/770] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:29 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:30.278538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-3638eb06-0e0d-4460-afe6-a3097f57bc0b req-c151515b-092c-4e93-947c-ccc563c4dc6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08c8b7f-24e0-47fe-9b46-87202f357774", "name": "network-vif-deleted", "tag": "06b84364-8b0e-41bc-bdb2-0e28411c93d0"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:30.286837 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3638eb06-0e0d-4460-afe6-a3097f57bc0b req-c151515b-092c-4e93-947c-ccc563c4dc6c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:30.287330 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3638eb06-0e0d-4460-afe6-a3097f57bc0b req-c151515b-092c-4e93-947c-ccc563c4dc6c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:30.298624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-3638eb06-0e0d-4460-afe6-a3097f57bc0b req-c151515b-092c-4e93-947c-ccc563c4dc6c service nova] Creating event network-vif-deleted:06b84364-8b0e-41bc-bdb2-0e28411c93d0 for instance f08c8b7f-24e0-47fe-9b46-87202f357774 on hv-cinder-84884 Jul 06 15:30:30.303399 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-3638eb06-0e0d-4460-afe6-a3097f57bc0b req-c151515b-092c-4e93-947c-ccc563c4dc6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029001 Jul 06 15:30:30.303990 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 406/771] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:30.449782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:30.450393 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:30.456406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:30.456856 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:30.457618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:30.458052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:30.662047 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:30.672495 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f8e51c8c-3918-4d0a-8461-80b21d424507 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 200 len: 1681 microversion: 2.1 time: 0.226539 Jul 06 15:30:30.673158 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 366/772] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:30 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:30.715870 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:30.716561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] [instance: ce440c64-f3db-4cda-8a2f-0f7e00f36b30] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:30.724077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:30.724523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:30.725292 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:30.725721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:30.739032 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] HTTP exception thrown: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 could not be found. Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Request method failure captured: Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 HTTP/1.1 Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalBpvBuBv4BaUaE2m0dDEyN5geTRYSJ2dfrrriheFGSIcjVDc3BdnqUpo-etU0q4BL1qGBxJ3juKDk0BwvOUgiHlbEZn_ean40sW0BMwimYVmDIedVne_OtGoTj_WQXnyPNne-4hDkByV9vivPwdae00JsdoOao1E5IP7WdlFuzSRw Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:30:30.741168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ef44ecc951964d51925463c5e09f9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: ef44ecc951964d51925463c5e09f9fbb Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-295658180 Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 46896be59b73481287235aac3d630f4e Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-ServerRescueNegativeTestJSON-295658180-project Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 could not be found. Jul 06 15:30:30.742760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'ce440c64-f3db-4cda-8a2f-0f7e00f36b30'} Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 could not be found. Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:30.743770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 could not be found. Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 could not be found. Jul 06 15:30:30.745266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:30:30.746871 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] Returning 404 to user: Instance ce440c64-f3db-4cda-8a2f-0f7e00f36b30 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:30.746871 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a9294c9b-93ce-448b-87b6-f638bc240e9b tempest-ServerRescueNegativeTestJSON-295658180 tempest-ServerRescueNegativeTestJSON-295658180-project] 10.222.0.46 "GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30" status: 404 len: 111 microversion: 2.1 time: 0.031024 Jul 06 15:30:30.746871 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 407/773] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:30 2022] GET /compute/v2.1/servers/ce440c64-f3db-4cda-8a2f-0f7e00f36b30 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:31.001331 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:31.002857 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] [instance: f08c8b7f-24e0-47fe-9b46-87202f357774] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:31.015534 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:31.016291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:31.019165 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:31.022711 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:31.043172 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] HTTP exception thrown: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 could not be found. Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Request method failure captured: Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 HTTP/1.1 Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixamnb-fSmnlus0UIT12Uo4ardc012QKsbivVfuUl_bA8h--9iPBPTMqc6psWVmacWnrg0PEJjWU6fJ-BchJHq2zplv1xBRmX3yDav220EiF9RHbyQ4IUZdBWJtwUpx4b_ILPIAIMaX3avi5Zn-V8x5d4f-LG8fL1JBVULUH-Fg57sGc Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 0805ca8c35a34d0dbf0f1e7ac459c517 Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-TestMinimumBasicScenario-644305013 Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:30:31.048852 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0805ca8c35a34d0dbf0f1e7ac459c517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-TestMinimumBasicScenario-644305013 Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 0805ca8c35a34d0dbf0f1e7ac459c517 Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-TestMinimumBasicScenario-644305013 Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-TestMinimumBasicScenario-644305013-project Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: b57356f7b4e748438b89d69663bb99ee Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-TestMinimumBasicScenario-644305013-project Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 could not be found. Jul 06 15:30:31.050473 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'f08c8b7f-24e0-47fe-9b46-87202f357774'} Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 could not be found. Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:31.051402 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 could not be found. Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 could not be found. Jul 06 15:30:31.053412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.059280 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Returning 404 to user: Instance f08c8b7f-24e0-47fe-9b46-87202f357774 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:31.065766 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-37e800ae-28ba-461e-ae85-fd66017acb00 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774" status: 404 len: 111 microversion: 2.1 time: 0.076646 Jul 06 15:30:31.070799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 367/774] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:30 2022] GET /compute/v2.1/servers/f08c8b7f-24e0-47fe-9b46-87202f357774 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:31.075361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d2bb9045-082e-40de-809e-ab35b25ea3b5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] Calling method '.version_select at 0x7f449d629160>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:31.103782 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d2bb9045-082e-40de-809e-ab35b25ea3b5 tempest-TestMinimumBasicScenario-644305013 tempest-TestMinimumBasicScenario-644305013-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2104323971" status: 202 len: 0 microversion: 2.1 time: 0.032498 Jul 06 15:30:31.107275 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 408/775] 10.222.0.46 () {58 vars in 1271 bytes} [Wed Jul 6 15:30:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2104323971 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:30:31.690722 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:31.691652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:31.699675 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:31.700135 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:31.701216 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:31.701653 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:31.724710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 HTTP/1.1 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:30:31.732323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:30:31.733892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '0889d118-1916-42f5-907d-37457f8ac6c0'} Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:30:31.734818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:30:31.736341 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:30:31.737811 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:30:31.738952 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-38c0babd-c4a2-463a-baf3-e577e1150699 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 404 len: 111 microversion: 2.1 time: 0.052818 Jul 06 15:30:31.740234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 368/776] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:31 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:31.750366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-63015027-6ed1-4162-9bbe-f2f638f3e9df tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '.version_select at 0x7f449cb47d30>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:31.773916 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-63015027-6ed1-4162-9bbe-f2f638f3e9df tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266623106" status: 202 len: 0 microversion: 2.1 time: 0.028656 Jul 06 15:30:31.774923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 409/777] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jul 6 15:30:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266623106 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 15:30:32.322155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-0f3122b8-cc64-436b-950c-6e8e08e8453e req-6a91d83c-8ba7-4bfc-a3d3-cc72dd5268f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0889d118-1916-42f5-907d-37457f8ac6c0", "name": "network-vif-deleted", "tag": "38f83667-978a-48ec-a53c-597a402f9348"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:32.328004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:32.337301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0f3122b8-cc64-436b-950c-6e8e08e8453e req-6a91d83c-8ba7-4bfc-a3d3-cc72dd5268f0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:32.337745 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0f3122b8-cc64-436b-950c-6e8e08e8453e req-6a91d83c-8ba7-4bfc-a3d3-cc72dd5268f0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:32.351395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-0f3122b8-cc64-436b-950c-6e8e08e8453e req-6a91d83c-8ba7-4bfc-a3d3-cc72dd5268f0 service nova] Creating event network-vif-deleted:38f83667-978a-48ec-a53c-597a402f9348 for instance 0889d118-1916-42f5-907d-37457f8ac6c0 on hv-cinder-84884 Jul 06 15:30:32.357313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-0f3122b8-cc64-436b-950c-6e8e08e8453e req-6a91d83c-8ba7-4bfc-a3d3-cc72dd5268f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040302 Jul 06 15:30:32.358320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 369/778] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:32.631190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dde8c5fc-7e30-434e-b53d-78f529ebd606 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: .version_select at 0x7f449cbdd8b0>, body: {"keypair": {"name": "tempest-keypair-717262638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERvBX5vIe3H7+0j+ygyqKuq780zDKRPvxShIVJEeZpLROlNhfajrbn9pKttWwjFxkNqEBazozN5btv8jVwMwdL9Fto/iQD0dOCstUTkwhleDolRopJqb4k7R1CIeMcHTA=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:32.648712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-dde8c5fc-7e30-434e-b53d-78f529ebd606 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:30:32.654439 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-dde8c5fc-7e30-434e-b53d-78f529ebd606 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:30:32.656930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:32.682463 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dde8c5fc-7e30-434e-b53d-78f529ebd606 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055898 Jul 06 15:30:32.683641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 410/779] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:30:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:34.040892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-143819389", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5"}], "security_groups": [{"name": "tempest-securitygroup--1545927142"}], "key_name": "tempest-keypair-717262638", "user_data": "}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:34.146381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] validate_networks() for [('a0e6b806-463a-4c5d-9ef6-10d2d99c1ec5', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:30:34.674598 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:30:34.675272 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:30:34.675926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:30:34.676502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:30:34.676925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:30:34.686184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:34.686856 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:34.687855 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:34.688851 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:34.709951 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:30:34.714115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Getting quotas for user 68676523b99247bf8f5b9a7553e67f26 and project e9fb04db8ac9464086cd7f3362e97455. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:30:34.726981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:30:34.729714 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:30:34.784567 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5c568d90-f95c-4f85-bf53-967eea8cc0db tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749576 Jul 06 15:30:34.785232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 370/780] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:30:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:30:34.796930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-35253ef8-cb44-4047-a58e-4bc4da1c15de tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:34.797679 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-35253ef8-cb44-4047-a58e-4bc4da1c15de tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:34.890746 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-35253ef8-cb44-4047-a58e-4bc4da1c15de tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:34.898014 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-35253ef8-cb44-4047-a58e-4bc4da1c15de tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1240 microversion: 2.1 time: 0.106107 Jul 06 15:30:34.898924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 411/781] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:34 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:35.920072 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:35.920689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:35.936082 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:35.945626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:35.946795 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:35.947794 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:36.155423 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:36.171469 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e522f728-6c21-4413-bdcd-0c560e3ec125 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1292 microversion: 2.1 time: 0.252883 Jul 06 15:30:36.173000 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 371/782] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:35 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1292 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:37.189627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:37.190850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:37.201273 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:37.201776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:37.204729 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:37.205122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:37.362267 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:37.372823 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f86b1899-97c8-4620-b586-8a2bd9ca8103 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1298 microversion: 2.1 time: 0.186954 Jul 06 15:30:37.374207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 412/783] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:37 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:38.402680 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:38.406500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:38.451552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:38.454074 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:38.460996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:38.462901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:38.820558 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:38.833854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f1e044f3-9529-4dbb-8ab0-159b5fb3ab6c tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1366 microversion: 2.1 time: 0.446283 Jul 06 15:30:38.836495 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 372/784] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:38 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:39.770305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-74b29873-4af1-459e-83e2-c5f4202e3f1c req-bbe302e4-8c02-46b3-a641-2327b12c7f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e81c452-7d6a-4c05-8e92-2d4239c6f0ac", "tag": "abf4f81b-5ad7-46a8-a9d5-c9974a4fa253"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:39.811905 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-74b29873-4af1-459e-83e2-c5f4202e3f1c req-bbe302e4-8c02-46b3-a641-2327b12c7f54 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:39.821304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-74b29873-4af1-459e-83e2-c5f4202e3f1c req-bbe302e4-8c02-46b3-a641-2327b12c7f54 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:39.842971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-74b29873-4af1-459e-83e2-c5f4202e3f1c req-bbe302e4-8c02-46b3-a641-2327b12c7f54 service nova] Creating event network-changed:abf4f81b-5ad7-46a8-a9d5-c9974a4fa253 for instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac on hv-cinder-84884 Jul 06 15:30:39.850792 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:39.852147 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:39.868710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-74b29873-4af1-459e-83e2-c5f4202e3f1c req-bbe302e4-8c02-46b3-a641-2327b12c7f54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109044 Jul 06 15:30:39.871049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:39.871719 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:39.872676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:39.873273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:39.877197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 413/785] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:40.728567 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:40.752528 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-13693f98-4af4-4066-88ff-14b1362fa63d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1366 microversion: 2.1 time: 0.904799 Jul 06 15:30:40.767022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 373/786] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:39 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1366 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:30:41.773605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:41.774921 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:41.805176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:41.805622 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:41.806990 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:41.807630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:42.067284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:42.079896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-938f395d-8daf-4c7e-8f93-48433d82b8ea tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1366 microversion: 2.1 time: 0.312332 Jul 06 15:30:42.090806 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 414/787] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:41 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:43.101348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:43.102618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:43.114881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:43.118530 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:43.119643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:43.120939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:43.598063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:43.629376 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1dacf96b-0d40-4ec3-b473-c2c3fa9a059d tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1366 microversion: 2.1 time: 0.534310 Jul 06 15:30:43.639547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 374/788] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:43 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:44.646835 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:44.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:44.659737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:44.661199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:44.663676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:44.664223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:44.702193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:44.723829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=6 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:44.803158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-07d1bfd4-b6e6-4d8b-993b-c460ecb0dbd8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'create', calling method: .version_select at 0x7f449cbcf8b0>, body: {"keypair": {"name": "tempest-keypair-379863273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgInYwsZtwkqEyV63ar0dRrSGfNcRUUIAvS2AJvJrP8pqc5ch+BslRtxh4P3jnQlDmjBbVWbQOYXwq98wXXJOsKeUGV1UPBR3Qr0VaLuaDBWp9C6MwtuHtMbOq8dIJcQ=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:44.831993 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-07d1bfd4-b6e6-4d8b-993b-c460ecb0dbd8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:30:44.844010 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-07d1bfd4-b6e6-4d8b-993b-c460ecb0dbd8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for user 2f35de73cde9436c952e0d5f95e74b8b and project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:30:44.885724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-07d1bfd4-b6e6-4d8b-993b-c460ecb0dbd8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.392463 Jul 06 15:30:44.888266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 415/789] 10.222.0.46 () {62 vars in 1199 bytes} [Wed Jul 6 15:30:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 396 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 06 15:30:45.028704 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:45.041272 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5844f95f-2339-4b06-8cab-e2f17d48e7c8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1366 microversion: 2.1 time: 0.399155 Jul 06 15:30:45.041910 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 375/790] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:44 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:45.789405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-abb33dc9-cac8-4bb8-8983-66d35ea92b41 req-9c52d245-b2e3-4c9d-85f5-6f178f9fc81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e81c452-7d6a-4c05-8e92-2d4239c6f0ac", "name": "network-vif-plugged", "status": "completed", "tag": "abf4f81b-5ad7-46a8-a9d5-c9974a4fa253"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:45.804922 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-abb33dc9-cac8-4bb8-8983-66d35ea92b41 req-9c52d245-b2e3-4c9d-85f5-6f178f9fc81d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:45.805649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-abb33dc9-cac8-4bb8-8983-66d35ea92b41 req-9c52d245-b2e3-4c9d-85f5-6f178f9fc81d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:45.836538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-abb33dc9-cac8-4bb8-8983-66d35ea92b41 req-9c52d245-b2e3-4c9d-85f5-6f178f9fc81d service nova] Creating event network-vif-plugged:abf4f81b-5ad7-46a8-a9d5-c9974a4fa253 for instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac on hv-cinder-84884 Jul 06 15:30:45.842981 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-abb33dc9-cac8-4bb8-8983-66d35ea92b41 req-9c52d245-b2e3-4c9d-85f5-6f178f9fc81d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183310 Jul 06 15:30:45.844208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 416/791] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:46.058896 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:46.060121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:46.073318 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:46.073944 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:46.075941 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:46.079436 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:46.392718 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:46.411068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e9e9ac82-43b4-4c2f-88b1-5478cbd397f1 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1366 microversion: 2.1 time: 0.356674 Jul 06 15:30:46.422451 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 376/792] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:46 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:47.217660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1688601802", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb1e65c9-bd94-49f0-bb47-fcf1417b4a1b"}], "security_groups": [{"name": "tempest-securitygroup--265547847"}], "key_name": "tempest-keypair-379863273", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:47.449239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:47.452694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:47.515964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:47.516728 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:47.520077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:47.522115 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:47.821188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] validate_networks() for [('bb1e65c9-bd94-49f0-bb47-fcf1417b4a1b', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:30:47.853625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:47.862053 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f3c67f0a-5d3a-4368-89d7-c637d7427141 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1556 microversion: 2.1 time: 0.433163 Jul 06 15:30:47.874682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 377/793] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:30:47 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1556 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:30:47.880557 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:47.881343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:47.888128 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:47.889168 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:47.890895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:47.891831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:48.012512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7c5f9e90-0850-45f7-8f28-df291d8aafc7 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136382 Jul 06 15:30:48.013255 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 378/794] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jul 6 15:30:47 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:48.690388 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:30:48.690840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:30:48.691296 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:30:48.691705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:30:48.693058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:30:48.709362 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:48.709812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:48.711024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:48.711492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:48.735806 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:30:48.740032 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for user 2f35de73cde9436c952e0d5f95e74b8b and project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:30:48.751538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:30:48.753908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:30:48.808708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-af2f5869-b663-4790-abdf-8856b16b7854 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.596085 Jul 06 15:30:48.809845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 417/795] 10.222.0.46 () {62 vars in 1187 bytes} [Wed Jul 6 15:30:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 06 15:30:48.821187 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ea96d2a4-0825-4de8-b933-f64aaceec840 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:48.821981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ea96d2a4-0825-4de8-b933-f64aaceec840 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:48.966309 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ea96d2a4-0825-4de8-b933-f64aaceec840 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:48.979493 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ea96d2a4-0825-4de8-b933-f64aaceec840 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:48.981214 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ea96d2a4-0825-4de8-b933-f64aaceec840 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:48.983594 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ea96d2a4-0825-4de8-b933-f64aaceec840 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1281 microversion: 2.20 time: 0.167367 Jul 06 15:30:48.984731 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 379/796] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:48 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:49.217210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:49.218682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:49.228627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:49.229506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:49.230669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:49.231320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:49.268678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2121a30d-8b58-427a-aaf7-fa9940be378a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/ips" status: 200 len: 146 microversion: 2.1 time: 0.057278 Jul 06 15:30:49.270472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 418/797] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:30:49 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/ips => generated 146 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:49.425683 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-5facdecf-b108-4b20-b126-3fadde34fdfb req-3f7f5ba5-2c6c-45a5-84d6-6fc338878572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e81c452-7d6a-4c05-8e92-2d4239c6f0ac", "tag": "abf4f81b-5ad7-46a8-a9d5-c9974a4fa253"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:49.438464 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5facdecf-b108-4b20-b126-3fadde34fdfb req-3f7f5ba5-2c6c-45a5-84d6-6fc338878572 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:49.439576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-5facdecf-b108-4b20-b126-3fadde34fdfb req-3f7f5ba5-2c6c-45a5-84d6-6fc338878572 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:49.453280 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-5facdecf-b108-4b20-b126-3fadde34fdfb req-3f7f5ba5-2c6c-45a5-84d6-6fc338878572 service nova] Creating event network-changed:abf4f81b-5ad7-46a8-a9d5-c9974a4fa253 for instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac on hv-cinder-84884 Jul 06 15:30:49.459508 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-5facdecf-b108-4b20-b126-3fadde34fdfb req-3f7f5ba5-2c6c-45a5-84d6-6fc338878572 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038610 Jul 06 15:30:49.460699 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 380/798] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:50.014415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:50.016824 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:50.025971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:50.026426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:50.028436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:50.029083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:50.148286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:50.160191 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:50.166394 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:50.168395 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bfad905b-1e7e-4a6d-b176-4cfd8d9383c6 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1351 microversion: 2.20 time: 0.169168 Jul 06 15:30:50.169501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 419/799] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:49 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:50.697327 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:50.699032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:50.708135 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:50.709228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:50.710646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:50.711338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:50.978829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d5e2c970-4ffc-4e20-a799-1d75eeb88a32 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285468 Jul 06 15:30:50.980968 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 381/800] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:30:50 2022] POST /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:30:51.186465 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:51.187019 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:51.193416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:51.193875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:51.194633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:51.195069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:51.341494 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:51.350647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:51.352665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:51.354069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cefc5305-8c11-46a4-9d19-37913d4b3e4e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.171570 Jul 06 15:30:51.354721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 420/801] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:51 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:51.691343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-422e648b-5b70-4575-950f-aba64cd4d6ce req-dc49c099-fd4d-4c57-a50e-53c0adad084c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:51.712559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-422e648b-5b70-4575-950f-aba64cd4d6ce req-dc49c099-fd4d-4c57-a50e-53c0adad084c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:51.713236 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-422e648b-5b70-4575-950f-aba64cd4d6ce req-dc49c099-fd4d-4c57-a50e-53c0adad084c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:51.724938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-422e648b-5b70-4575-950f-aba64cd4d6ce req-dc49c099-fd4d-4c57-a50e-53c0adad084c service nova] Creating event network-changed:a3380706-64df-4d3c-b081-f2075be880fa for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 on hv-cinder-84884 Jul 06 15:30:51.734163 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-422e648b-5b70-4575-950f-aba64cd4d6ce req-dc49c099-fd4d-4c57-a50e-53c0adad084c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049276 Jul 06 15:30:51.735010 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 382/802] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:52.372523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:52.373121 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:52.379541 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:52.379982 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:52.380732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:52.381158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:52.507054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:52.515058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:52.516591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:52.517678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-112b4971-c183-4e1f-bad6-236c92b1cbc2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.149061 Jul 06 15:30:52.518238 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 421/803] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:52 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:53.537895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:53.538696 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:53.544835 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:53.545283 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:53.546042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:53.546470 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:53.680483 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:53.688359 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:53.689846 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:53.690920 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7fe414a4-8002-4dcd-bc4e-7caeb88308d3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.158458 Jul 06 15:30:53.691502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 383/804] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:53 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:54.708461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:54.709086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:54.715591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:54.716042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:54.716808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:54.717239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:54.721368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:54.850549 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:54.858485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:54.860037 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:54.861167 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-201f2d16-cde4-4aee-b1ab-df2abe4a4d84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.156652 Jul 06 15:30:54.861727 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 422/805] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:54 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:55.878611 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:55.879143 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:55.886425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:55.886870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:55.887659 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:55.888094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:56.018476 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:56.026562 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:56.028087 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:56.029175 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b8a30680-7f41-4ed2-80f2-67656d2914fa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.154531 Jul 06 15:30:56.029732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 384/806] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:55 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:57.047263 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:57.047787 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:57.054244 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.054683 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.055455 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.055885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.186459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:57.194949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:57.196534 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:57.197636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-57990aeb-34a2-4429-aff8-7c0276596394 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.154381 Jul 06 15:30:57.198457 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 423/807] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:57 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:57.422352 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:57.423313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:57.430171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.430623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.431421 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.431859 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.446980 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:57.464649 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-56849ca5-10e1-41b5-a5b8-285e95e6595d tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046267 Jul 06 15:30:57.465209 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 385/808] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:30:57 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:57.475091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:57.475643 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:57.481812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.482404 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.483411 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.483911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.514311 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b4431dc-b5e6-4232-9057-fc0ad43b6bd1 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30" status: 200 len: 194 microversion: 2.1 time: 0.043046 Jul 06 15:30:57.515109 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 424/809] 10.222.0.46 () {58 vars in 1412 bytes} [Wed Jul 6 15:30:57 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:57.597306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-0bfe1315-4be8-4476-bb53-6be01a34da8a req-c1063053-1cec-4d13-8514-bca2efd1d828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "name": "network-vif-plugged", "status": "completed", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:57.607353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0bfe1315-4be8-4476-bb53-6be01a34da8a req-c1063053-1cec-4d13-8514-bca2efd1d828 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:57.607872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0bfe1315-4be8-4476-bb53-6be01a34da8a req-c1063053-1cec-4d13-8514-bca2efd1d828 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:57.620504 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-0bfe1315-4be8-4476-bb53-6be01a34da8a req-c1063053-1cec-4d13-8514-bca2efd1d828 service nova] Creating event network-vif-plugged:a3380706-64df-4d3c-b081-f2075be880fa for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 on hv-cinder-84884 Jul 06 15:30:57.626264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-0bfe1315-4be8-4476-bb53-6be01a34da8a req-c1063053-1cec-4d13-8514-bca2efd1d828 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 Jul 06 15:30:57.626976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 386/810] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:58.215608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:58.216221 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:58.222627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:58.223077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:58.224499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:58.224965 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:58.351714 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:58.359576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:58.361105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:58.362206 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d8dbd54a-b906-4728-b495-f56b46556629 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1406 microversion: 2.20 time: 0.150578 Jul 06 15:30:58.362776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 425/811] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:58 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:30:58.855145 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a902487-58e3-4046-a79f-fbf18b0c55d0"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:30:58.856294 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:58.862344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:58.862780 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:58.863555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:58.863982 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:58.977908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:59.379891 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:59.380495 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:59.382347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:59.382991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=16 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:59.389666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:59.390111 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:59.390864 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:59.391320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:59.423251 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b870b221-1838-4cfa-93d0-10c4a8b468b8 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "POST /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572640 Jul 06 15:30:59.424037 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 387/812] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:30:58 2022] POST /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:30:59.531689 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:59.540384 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:59.541920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:30:59.543074 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0d1f6c90-899e-4712-9537-1f3014670d34 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1598 microversion: 2.20 time: 0.167147 Jul 06 15:30:59.543693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 426/813] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:30:59 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:30:59.561943 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:30:59.562595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:30:59.569399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:59.569925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:59.570759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:30:59.571321 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:30:59.651045 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d78507f1-80fb-433f-826a-9da96a130b38 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093725 Jul 06 15:30:59.651717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 388/814] 10.222.0.46 () {60 vars in 1315 bytes} [Wed Jul 6 15:30:59 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:31:00.739152 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-290e7aa6-859b-4181-a82f-0de08260ab34 req-52165213-8619-4723-b99c-e5175a1fab1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:00.747930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-290e7aa6-859b-4181-a82f-0de08260ab34 req-52165213-8619-4723-b99c-e5175a1fab1a service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:00.748419 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-290e7aa6-859b-4181-a82f-0de08260ab34 req-52165213-8619-4723-b99c-e5175a1fab1a service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:00.759092 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-290e7aa6-859b-4181-a82f-0de08260ab34 req-52165213-8619-4723-b99c-e5175a1fab1a service nova] Creating event network-changed:a3380706-64df-4d3c-b081-f2075be880fa for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 on hv-cinder-84884 Jul 06 15:31:00.763944 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-290e7aa6-859b-4181-a82f-0de08260ab34 req-52165213-8619-4723-b99c-e5175a1fab1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208048 Jul 06 15:31:00.764803 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 427/815] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:06.916833 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:06.917744 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:06.919673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:06.924742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:06.925184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:06.925933 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:06.926359 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:06.956428 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2e5acdc9-dd6e-4c3b-82b4-f509dca4c446 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044076 Jul 06 15:31:06.956974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 389/816] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:31:06 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:07.098390 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:07.098911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:07.101440 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=5 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:07.107347 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:07.107795 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:07.108550 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:07.108984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:07.136333 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d59e68cd-cc2f-49cb-9961-468b7a350c38 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30" status: 200 len: 194 microversion: 2.1 time: 0.043142 Jul 06 15:31:07.136909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 428/817] 10.222.0.46 () {58 vars in 1412 bytes} [Wed Jul 6 15:31:07 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:07.146288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:07.147313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:07.153410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:07.153849 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:07.154620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:07.155053 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:07.236244 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lazy-loading 'services' on Instance uuid da295c29-c8ab-4451-8e09-c814b1288b4f {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:31:07.305358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d1cdc0b6-ccca-49b5-8e82-bf6b880b3ed4 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30" status: 202 len: 0 microversion: 2.1 time: 0.162735 Jul 06 15:31:07.305980 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 390/818] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:31:07 2022] DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/6c7bc6fa-7815-48dc-9b55-6a6aed3b5c30 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:31:08.415312 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:08.415818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:08.422271 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:08.422718 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:08.423515 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:08.423954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:08.453628 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b45ba6c4-ab21-4a1e-98c0-68a1cbf00a6a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/5a902487-58e3-4046-a79f-fbf18b0c55d0" status: 200 len: 194 microversion: 2.1 time: 0.042199 Jul 06 15:31:08.454229 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 429/819] 10.222.0.46 () {58 vars in 1412 bytes} [Wed Jul 6 15:31:08 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/5a902487-58e3-4046-a79f-fbf18b0c55d0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:08.465524 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:08.466098 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:08.472207 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:08.472648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:08.473395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:08.473823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:08.551800 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lazy-loading 'services' on Instance uuid da295c29-c8ab-4451-8e09-c814b1288b4f {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:31:08.620325 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ae7e1bfc-8a9f-47c3-b853-f499fd6126a5 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/5a902487-58e3-4046-a79f-fbf18b0c55d0" status: 202 len: 0 microversion: 2.1 time: 0.159318 Jul 06 15:31:08.621032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 391/820] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:31:08 2022] DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments/5a902487-58e3-4046-a79f-fbf18b0c55d0 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:31:09.776518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:09.777494 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:09.784114 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:09.784566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:09.785333 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:09.785770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:09.815117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f8ff29f9-9f71-4224-9b3e-aa2fa358664a tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043450 Jul 06 15:31:09.815747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 430/821] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:31:09 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:31:09.920399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:09.921461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:09.927631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:09.928078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:09.928839 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:09.929322 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:09.958022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9d9301d3-adbf-477c-a95c-e867bd8a7449 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042435 Jul 06 15:31:09.958570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 392/822] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:31:09 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:31:10.014803 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:10.015336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:10.021217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:10.022294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:10.023056 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:10.023524 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:10.047821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:31:10.121502 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b83acec6-eda5-4a16-9b5f-6e2ba0e67353 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 204 len: 0 microversion: 2.1 time: 0.110174 Jul 06 15:31:10.122087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 431/823] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:10 2022] DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:31:10.131484 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:10.132096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:10.137990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:10.138445 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:10.139204 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:10.139665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:10.272895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:10.280598 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-12aebd4c-22a2-4099-9ec2-35ebd804a14c tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1673 microversion: 2.1 time: 0.153762 Jul 06 15:31:10.281173 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 393/824] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:10 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:11.298147 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:11.298842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:11.305306 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:11.305777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:11.306529 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:11.306955 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:11.435774 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:11.443562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e79e572d-5633-4802-880a-54f02e771644 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1673 microversion: 2.1 time: 0.149087 Jul 06 15:31:11.444148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 432/825] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:11 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:12.460179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:12.460792 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:12.467581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:12.468019 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:12.468787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:12.469223 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:12.681435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5497ff570f4affbbd1b2f9129c24ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707399c704e4c97939dc84df58cb39f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:12.688982 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4e7363d9-92e0-4e5e-8cba-c473577e556e tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 200 len: 1673 microversion: 2.1 time: 0.233169 Jul 06 15:31:12.689551 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 394/826] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:12 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:12.939277 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-095e5ddd-db21-48fa-9cb3-a344f96352b7 req-a93c022a-7256-4b9e-a977-39a676d7a164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da295c29-c8ab-4451-8e09-c814b1288b4f", "name": "network-vif-deleted", "tag": "0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:12.948655 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-095e5ddd-db21-48fa-9cb3-a344f96352b7 req-a93c022a-7256-4b9e-a977-39a676d7a164 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:12.949118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-095e5ddd-db21-48fa-9cb3-a344f96352b7 req-a93c022a-7256-4b9e-a977-39a676d7a164 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:12.961342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-095e5ddd-db21-48fa-9cb3-a344f96352b7 req-a93c022a-7256-4b9e-a977-39a676d7a164 service nova] Creating event network-vif-deleted:0779bfb0-7c7d-4f21-8bba-7c769dbfd0f8 for instance da295c29-c8ab-4451-8e09-c814b1288b4f on hv-cinder-84884 Jul 06 15:31:12.966302 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-095e5ddd-db21-48fa-9cb3-a344f96352b7 req-a93c022a-7256-4b9e-a977-39a676d7a164 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Jul 06 15:31:12.967264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 433/827] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:13.705927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:13.706481 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:13.713863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:13.714305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:13.715065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:13.715526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:13.730985 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] HTTP exception thrown: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Request method failure captured: Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f HTTP/1.1 Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixak9F-8uYskSX4fVV7G_UzX0VUABmw4BU1YthB6Y32JhQcb6PfcK8N3F80mZzaASjOPuWkXgLx1mqql7b3FpEDYtbb3rkLN8bIAePzcckl7qh-QvimzXvRXw5oX13Kg5nF7vT60_VU74152CsCd-Qj-ON7Hkas88ncj65mKJYTTHPFY Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:13.732623 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6707399c704e4c97939dc84df58cb39f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 0f5497ff570f4affbbd1b2f9129c24ac Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:13.734254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'da295c29-c8ab-4451-8e09-c814b1288b4f'} Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:13.735520 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:13.736906 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:13.738550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Returning 404 to user: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:13.738550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2bf024dd-766e-4812-a7bf-e342ce7401a0 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 404 len: 111 microversion: 2.1 time: 0.032031 Jul 06 15:31:13.738550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 395/828] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:13 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:13.744220 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c0e58db7-def1-45e5-aaec-a53ba01653f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '.version_select at 0x7f449cbfb940>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:13.762380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c0e58db7-def1-45e5-aaec-a53ba01653f9 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853473892" status: 202 len: 0 microversion: 2.1 time: 0.022667 Jul 06 15:31:13.762986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 434/829] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jul 6 15:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853473892 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:31:16.631013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:16.631535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:16.637891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:16.638339 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:16.639089 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:16.639549 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:16.653521 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] HTTP exception thrown: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Request method failure captured: Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f HTTP/1.1 Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixak9F-8uYskSX4fVV7G_UzX0VUABmw4BU1YthB6Y32JhQcb6PfcK8N3F80mZzaASjOPuWkXgLx1mqql7b3FpEDYtbb3rkLN8bIAePzcckl7qh-QvimzXvRXw5oX13Kg5nF7vT60_VU74152CsCd-Qj-ON7Hkas88ncj65mKJYTTHPFY Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:16.655015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6707399c704e4c97939dc84df58cb39f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 0f5497ff570f4affbbd1b2f9129c24ac Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.656595 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'da295c29-c8ab-4451-8e09-c814b1288b4f'} Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:16.657457 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.658662 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.660338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Returning 404 to user: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:16.660338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8b5811eb-2fba-4105-aa0b-94440177df4f tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 404 len: 111 microversion: 2.1 time: 0.029691 Jul 06 15:31:16.660338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 396/830] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:16 2022] DELETE /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:16.665360 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:16.666119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: da295c29-c8ab-4451-8e09-c814b1288b4f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:16.672204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:16.672647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:16.673391 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:16.673816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:16.686702 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] HTTP exception thrown: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Request method failure captured: Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f HTTP/1.1 Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixak9F-8uYskSX4fVV7G_UzX0VUABmw4BU1YthB6Y32JhQcb6PfcK8N3F80mZzaASjOPuWkXgLx1mqql7b3FpEDYtbb3rkLN8bIAePzcckl7qh-QvimzXvRXw5oX13Kg5nF7vT60_VU74152CsCd-Qj-ON7Hkas88ncj65mKJYTTHPFY Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:16.688274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6707399c704e4c97939dc84df58cb39f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 0f5497ff570f4affbbd1b2f9129c24ac Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.689804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'da295c29-c8ab-4451-8e09-c814b1288b4f'} Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:16.690676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. Jul 06 15:31:16.692138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:16.693887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Returning 404 to user: Instance da295c29-c8ab-4451-8e09-c814b1288b4f could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:16.693887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-740a1a42-ccc5-4bd2-87b3-4602405ade12 tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f" status: 404 len: 111 microversion: 2.1 time: 0.028754 Jul 06 15:31:16.694133 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 435/831] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:16 2022] GET /compute/v2.1/servers/da295c29-c8ab-4451-8e09-c814b1288b4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:17.822238 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:17.822723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:17.829247 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:17.829689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:17.830440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:17.830870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:17.844511 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] HTTP exception thrown: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Request method failure captured: Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 HTTP/1.1 Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixak9F-8uYskSX4fVV7G_UzX0VUABmw4BU1YthB6Y32JhQcb6PfcK8N3F80mZzaASjOPuWkXgLx1mqql7b3FpEDYtbb3rkLN8bIAePzcckl7qh-QvimzXvRXw5oX13Kg5nF7vT60_VU74152CsCd-Qj-ON7Hkas88ncj65mKJYTTHPFY Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:17.846011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6707399c704e4c97939dc84df58cb39f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 0f5497ff570f4affbbd1b2f9129c24ac Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.847543 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '3811251a-a0ba-4f29-9160-96c0f3f46c52'} Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:17.848474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.850569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.852410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Returning 404 to user: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:17.852410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3fe40afd-d735-415d-86cc-3e7c14ce62ee tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 404 len: 111 microversion: 2.1 time: 0.029035 Jul 06 15:31:17.852410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 397/832] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:17 2022] DELETE /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:17.856231 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:17.856840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] [instance: 3811251a-a0ba-4f29-9160-96c0f3f46c52] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:17.862880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:17.863350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:17.864097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:17.864525 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:17.877525 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] HTTP exception thrown: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Request method failure captured: Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 HTTP/1.1 Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixak9F-8uYskSX4fVV7G_UzX0VUABmw4BU1YthB6Y32JhQcb6PfcK8N3F80mZzaASjOPuWkXgLx1mqql7b3FpEDYtbb3rkLN8bIAePzcckl7qh-QvimzXvRXw5oX13Kg5nF7vT60_VU74152CsCd-Qj-ON7Hkas88ncj65mKJYTTHPFY Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:17.879022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6707399c704e4c97939dc84df58cb39f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6707399c704e4c97939dc84df58cb39f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6707399c704e4c97939dc84df58cb39f Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590838834 Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 0f5497ff570f4affbbd1b2f9129c24ac Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeTestJSON-590838834-project Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.880570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '3811251a-a0ba-4f29-9160-96c0f3f46c52'} Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:17.881444 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. Jul 06 15:31:17.883008 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:17.884478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] Returning 404 to user: Instance 3811251a-a0ba-4f29-9160-96c0f3f46c52 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:17.884478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8079806e-1bfc-4522-bdad-14c5cf15f1ef tempest-AttachVolumeTestJSON-590838834 tempest-AttachVolumeTestJSON-590838834-project] 10.222.0.46 "GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52" status: 404 len: 111 microversion: 2.1 time: 0.027987 Jul 06 15:31:17.884478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 436/833] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:17 2022] GET /compute/v2.1/servers/3811251a-a0ba-4f29-9160-96c0f3f46c52 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:22.236429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a0070caa-bae0-4839-9612-cc50e71819ae tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Action: 'create', calling method: .version_select at 0x7f449c4358b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2003337681", "metadata": {"Type": "work"}}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:22.537372 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a0070caa-bae0-4839-9612-cc50e71819ae tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.417770 Jul 06 15:31:22.538335 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 398/834] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jul 6 15:31:22 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 06 15:31:22.549697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-04bdccea-92c9-404c-bd86-edaacf4f25eb tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Calling method '.version_select at 0x7f449d4ba280>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:22.602771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-04bdccea-92c9-404c-bd86-edaacf4f25eb tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39" status: 200 len: 353 microversion: 2.1 time: 0.056956 Jul 06 15:31:22.603447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 437/835] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:22 2022] GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:23.616622 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-60d49c38-86dc-41d3-afdb-0bef76767dbd tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Calling method '.version_select at 0x7f449c3244c0>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:23.662561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-60d49c38-86dc-41d3-afdb-0bef76767dbd tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39" status: 200 len: 354 microversion: 2.1 time: 0.051148 Jul 06 15:31:23.663122 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 399/836] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:23 2022] GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:23.674547 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2f5779ec-f5e2-4fb5-8316-e82550897ca8 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Calling method '.version_select at 0x7f449cb63430>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:23.720722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2f5779ec-f5e2-4fb5-8316-e82550897ca8 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39" status: 200 len: 354 microversion: 2.1 time: 0.050308 Jul 06 15:31:23.721361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 438/837] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:23 2022] GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:23.736875 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d708ae4a-1ded-44b0-a54f-5e246b62595c tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Calling method '.version_select at 0x7f449c2881f0>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:23.802433 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d708ae4a-1ded-44b0-a54f-5e246b62595c tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39" status: 202 len: 0 microversion: 2.1 time: 0.069209 Jul 06 15:31:23.803551 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 400/838] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:31:23 2022] DELETE /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:31:23.811772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b5a9a8c0-1515-4042-90a8-a489e6bca254 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Calling method '.version_select at 0x7f449cbea9d0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:23.858930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b5a9a8c0-1515-4042-90a8-a489e6bca254 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39" status: 200 len: 353 microversion: 2.1 time: 0.050927 Jul 06 15:31:23.859570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 439/839] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:23 2022] GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:24.871872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5ed11436-a77e-4d5c-955b-8a89c2bcef42 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Calling method '.version_select at 0x7f449c252820>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:24.900236 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-5ed11436-a77e-4d5c-955b-8a89c2bcef42 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] HTTP exception thrown: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5ed11436-a77e-4d5c-955b-8a89c2bcef42 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Request method failure captured: Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 HTTP/1.1 Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixarKPN3jI5mRGKr8BXmH4qmHjw3QSxuO3FCWVFNXQ5DhfmRPA9bsizOpkFKMF0i7O7w7Cg-2AstRFy2ks8DUzTzZF3fT1hK65rJFOpX3BQZ2XikSyysj0QLWK_dIQYTzt4Rt-CckQRXtFxbOJUvpL_fvxI5jVvOVpbTSmvXPk4nYz9s Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: b0d76cc3eba54cca8e3ffee467e4487d Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-VolumesGetTestJSON-818473892 Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:24.902132 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b0d76cc3eba54cca8e3ffee467e4487d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b0d76cc3eba54cca8e3ffee467e4487d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b0d76cc3eba54cca8e3ffee467e4487d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b0d76cc3eba54cca8e3ffee467e4487d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-VolumesGetTestJSON-818473892 Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: b0d76cc3eba54cca8e3ffee467e4487d Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-VolumesGetTestJSON-818473892 Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-VolumesGetTestJSON-818473892-project Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: f1c93f4c328f4b0baf9476b1c18848df Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-VolumesGetTestJSON-818473892-project Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '880e9ff5-4930-4cff-a7f6-11868e27de39'} Jul 06 15:31:24.903748 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. (HTTP 404) (Request-ID: req-f0ec3544-7b3a-4e29-b9a6-45cd2fa8207d) Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:24.904824 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 06 15:31:24.906265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 06 15:31:24.907705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5ed11436-a77e-4d5c-955b-8a89c2bcef42 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] Returning 404 to user: Volume 880e9ff5-4930-4cff-a7f6-11868e27de39 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5ed11436-a77e-4d5c-955b-8a89c2bcef42 tempest-VolumesGetTestJSON-818473892 tempest-VolumesGetTestJSON-818473892-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39" status: 404 len: 109 microversion: 2.1 time: 0.036039 Jul 06 15:31:24.909123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 401/840] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:24 2022] GET /compute/v2.1/os-volumes/880e9ff5-4930-4cff-a7f6-11868e27de39 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:27.458451 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:27.460188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:27.472001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:27.472461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:27.473319 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:27.473662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:27.478979 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:27.500264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ae6ab6c-5a5a-4ad0-b557-b85e9fa56efc tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/ips" status: 200 len: 150 microversion: 2.1 time: 0.046072 Jul 06 15:31:27.500858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 440/841] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jul 6 15:31:27 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:28.829429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=17 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:28.830184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:28.835539 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c37c813-894e-446d-9240-f0f551c8c2e4"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:28.836895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:28.844157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:28.844604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:28.845374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:28.845807 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:29.091939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fb7f89fa-06f0-4bf0-baf4-ac6463160cfd tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "POST /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263329 Jul 06 15:31:29.092536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 402/842] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jul 6 15:31:28 2022] POST /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:35.628330 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:35.628939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:35.635579 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:35.635966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:35.636738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:35.637179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:35.717695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lazy-loading 'services' on Instance uuid 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:31:35.791614 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fefbd953-e2cf-468b-b106-9e58a3cc1ae5 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments/9c37c813-894e-446d-9240-f0f551c8c2e4" status: 202 len: 0 microversion: 2.1 time: 0.167214 Jul 06 15:31:35.792406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 441/843] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jul 6 15:31:35 2022] DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments/9c37c813-894e-446d-9240-f0f551c8c2e4 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:31:35.802887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:35.804096 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:35.811782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:35.812550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:35.813414 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:35.813926 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:35.847624 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-456f186a-bed3-4191-bc7a-3689abd5c1f6 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 Jul 06 15:31:35.848504 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 403/844] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:31:35 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:36.608625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:36.609200 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:36.615869 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:36.616314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:36.617059 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:36.617487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:36.641317 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-03ca17fa-822d-4378-b4d2-809bc87bfa35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/ips" status: 200 len: 151 microversion: 2.20 time: 0.036931 Jul 06 15:31:36.641920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 442/845] 10.222.0.46 () {60 vars in 1288 bytes} [Wed Jul 6 15:31:36 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:31:36.860415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:36.862105 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:36.869427 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:36.869954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:36.870818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:36.871355 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:36.900854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-811a7ce6-2dbf-4377-823f-67e3ff786eb3 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044863 Jul 06 15:31:36.901425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 404/846] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jul 6 15:31:36 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 06 15:31:36.962977 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:36.963596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:36.970804 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:36.971343 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:36.972321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:36.972816 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:36.999017 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:31:37.072396 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-add40f6d-4a44-4ad5-9d49-d1047d4fc0a2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 204 len: 0 microversion: 2.1 time: 0.113696 Jul 06 15:31:37.073209 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 443/847] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:36 2022] DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:31:37.081966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:37.082584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:37.088928 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:37.089378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:37.090136 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:37.090574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:37.228369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:37.235815 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b184fca1-2765-41a7-8fbb-8727e03eb029 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1681 microversion: 2.1 time: 0.157702 Jul 06 15:31:37.236382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 405/848] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:37 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:38.253508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:38.254208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:38.256642 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:38.261873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:38.262308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:38.263060 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:38.263513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:38.389410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:38.396707 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8b355df3-92a8-4cbe-b84e-4e4068be4e51 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1681 microversion: 2.1 time: 0.147583 Jul 06 15:31:38.397282 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 444/849] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:38 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:38.811846 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:38.812584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:38.819466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:38.820002 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:38.820843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:38.821350 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:38.845614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lazy-loading 'flavor' on Instance uuid 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:31:39.306990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dd5b11d4-08ba-4cef-9788-20770942def7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/action" status: 202 len: 0 microversion: 2.20 time: 0.498766 Jul 06 15:31:39.308858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 406/850] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jul 6 15:31:38 2022] POST /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:31:39.317763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:39.319911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:39.327724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:39.328750 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:39.330023 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:39.330467 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:39.413713 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:39.414665 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:39.421123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:39.421754 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:39.422666 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:39.423434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:39.508731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:39.522822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:39.525253 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:39.525536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68676523b99247bf8f5b9a7553e67f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9fb04db8ac9464086cd7f3362e97455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:39.527511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ec8b64bf-830c-48ee-b363-0e916bcd7a8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.214342 Jul 06 15:31:39.528609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 445/851] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:39 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:39.534275 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a75aba26-8506-4ee6-b661-9d33c1cc0f06 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 200 len: 1613 microversion: 2.1 time: 0.124731 Jul 06 15:31:39.535022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 407/852] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:39 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:39.609900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-c790a9c9-9d0b-4714-b649-9fbded2ba6fc req-508482f0-790e-4531-a6d9-6870abedde10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e81c452-7d6a-4c05-8e92-2d4239c6f0ac", "name": "network-vif-deleted", "tag": "abf4f81b-5ad7-46a8-a9d5-c9974a4fa253"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:39.620696 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c790a9c9-9d0b-4714-b649-9fbded2ba6fc req-508482f0-790e-4531-a6d9-6870abedde10 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:39.621374 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c790a9c9-9d0b-4714-b649-9fbded2ba6fc req-508482f0-790e-4531-a6d9-6870abedde10 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:39.638500 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-c790a9c9-9d0b-4714-b649-9fbded2ba6fc req-508482f0-790e-4531-a6d9-6870abedde10 service nova] Creating event network-vif-deleted:abf4f81b-5ad7-46a8-a9d5-c9974a4fa253 for instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac on hv-cinder-84884 Jul 06 15:31:39.649615 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-c790a9c9-9d0b-4714-b649-9fbded2ba6fc req-508482f0-790e-4531-a6d9-6870abedde10 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048108 Jul 06 15:31:39.650522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 446/853] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:40.547521 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:40.548121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:40.555124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:40.555602 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:40.556180 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:40.556642 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:40.556788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:40.557303 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:40.566700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:40.570909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:40.572207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:40.572937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:40.591398 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac HTTP/1.1 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:40.593299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:40.595958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '2e81c452-7d6a-4c05-8e92-2d4239c6f0ac'} Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:40.596937 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:40.598423 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:40.602372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:40.603250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a42982e9-2cfe-4af0-9473-c4e65f5aa905 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 404 len: 111 microversion: 2.1 time: 0.055983 Jul 06 15:31:40.603997 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 447/854] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:40 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:40.612055 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5230d53c-d87c-46a5-8ed5-a1ef59361df8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '.version_select at 0x7f449cb47820>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:40.636785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5230d53c-d87c-46a5-8ed5-a1ef59361df8 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717262638" status: 202 len: 0 microversion: 2.1 time: 0.028250 Jul 06 15:31:40.638170 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 448/855] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jul 6 15:31:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717262638 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 06 15:31:40.718639 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:40.726930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:40.728872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:40.730114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-abd7d465-5ff1-43fe-baaa-53be21bf20e3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.186417 Jul 06 15:31:40.730666 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 408/856] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:40 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:31:41.749035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:41.749634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:41.756799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:41.757327 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:41.758084 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:41.758510 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:41.893777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:41.902829 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:41.904582 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:41.905764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e8082793-0470-42c4-9aba-820b15d6f0df tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.160959 Jul 06 15:31:41.906329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 449/857] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:41 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:42.398987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:42.399521 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:42.405931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:42.406382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:42.407137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:42.407602 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:42.420301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac HTTP/1.1 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:42.421914 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.423509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '2e81c452-7d6a-4c05-8e92-2d4239c6f0ac'} Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:42.424440 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.425664 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.427389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:42.427389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4122257a-3e52-421c-9397-8ea27c430f98 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 404 len: 111 microversion: 2.1 time: 0.028417 Jul 06 15:31:42.427389 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 409/858] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:42 2022] DELETE /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:42.431930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:42.432566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:42.438411 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:42.438861 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:42.439649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:42.440083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:42.453697 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac HTTP/1.1 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:42.455205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.456726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '2e81c452-7d6a-4c05-8e92-2d4239c6f0ac'} Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:42.457735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. Jul 06 15:31:42.459179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:42.461197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance 2e81c452-7d6a-4c05-8e92-2d4239c6f0ac could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:42.461197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-909af550-ca92-409b-9e7a-e3732da41664 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac" status: 404 len: 111 microversion: 2.1 time: 0.028996 Jul 06 15:31:42.461197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 450/859] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:42 2022] GET /compute/v2.1/servers/2e81c452-7d6a-4c05-8e92-2d4239c6f0ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:31:42.923830 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:42.924368 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:42.930911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:42.931395 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:42.932152 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:42.932587 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.066479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:43.074738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:43.076265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:43.077441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9d67da9c-a212-4a11-8eed-c696cb206956 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.157601 Jul 06 15:31:43.077969 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 410/860] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:42 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:43.588130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:43.588627 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:43.594970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.595459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.596208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.596632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.611337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 HTTP/1.1 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:43.612831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.614417 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '0889d118-1916-42f5-907d-37457f8ac6c0'} Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:43.615596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.617035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.618590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:43.618590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-05e9fa0e-7f16-4e7f-b03e-4c75c34c6228 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 404 len: 111 microversion: 2.1 time: 0.030612 Jul 06 15:31:43.618590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 451/861] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:43 2022] DELETE /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:43.622302 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:43.622904 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: 0889d118-1916-42f5-907d-37457f8ac6c0] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:43.629313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.629750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.630499 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.631434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.644093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 HTTP/1.1 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:43.645573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.647750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '0889d118-1916-42f5-907d-37457f8ac6c0'} Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:43.648953 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. Jul 06 15:31:43.650364 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.651857 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance 0889d118-1916-42f5-907d-37457f8ac6c0 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:43.651857 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-48860ec8-465a-4ef9-976c-584762af4df2 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0" status: 404 len: 111 microversion: 2.1 time: 0.028934 Jul 06 15:31:43.651857 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 411/862] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:43 2022] GET /compute/v2.1/servers/0889d118-1916-42f5-907d-37457f8ac6c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:43.656190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:43.656689 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:43.662715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.663350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.664118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.664557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.677616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 HTTP/1.1 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:43.679130 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.680738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'e44071dc-0ea5-446e-8cf3-8509970b78a8'} Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:43.681728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.683164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.684949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:43.684949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a8f68507-995c-4e47-85a0-aaa5b299bc82 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 404 len: 111 microversion: 2.1 time: 0.028165 Jul 06 15:31:43.684949 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 452/863] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:43 2022] DELETE /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 06 15:31:43.688721 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:43.689328 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: e44071dc-0ea5-446e-8cf3-8509970b78a8] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:43.695855 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.696291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.697039 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:43.697468 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:43.710812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 HTTP/1.1 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:43.712316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.713843 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'e44071dc-0ea5-446e-8cf3-8509970b78a8'} Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:43.714863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. Jul 06 15:31:43.716301 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:43.717979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance e44071dc-0ea5-446e-8cf3-8509970b78a8 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:43.717979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dd7e3c3c-413b-4225-8600-92623309da13 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8" status: 404 len: 111 microversion: 2.1 time: 0.028697 Jul 06 15:31:43.717979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 412/864] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:43 2022] GET /compute/v2.1/servers/e44071dc-0ea5-446e-8cf3-8509970b78a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:44.095899 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:44.096886 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:44.104214 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:44.104674 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:44.105439 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:44.105873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:44.230896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:44.238731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:44.240284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:44.241442 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-59ed8603-d524-4393-98ce-9ea0ae36b4c3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.149908 Jul 06 15:31:44.242002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 453/865] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:44 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:44.846738 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:44.847252 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:44.854550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:44.854997 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:44.855788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:44.856224 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:44.870897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 HTTP/1.1 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:31:44.877256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.878938 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'a347082e-a86f-46f0-a018-e3918e3e8262'} Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:44.880049 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.881576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.883048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:44.883048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9444eb14-8737-489c-a6b8-af1f0f18fd88 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 404 len: 111 microversion: 2.1 time: 0.032142 Jul 06 15:31:44.883048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 413/866] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:31:44 2022] DELETE /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:44.883764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:44.883764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] [instance: a347082e-a86f-46f0-a018-e3918e3e8262] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:44.889526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:44.889977 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:44.890744 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:44.891181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:44.904939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] HTTP exception thrown: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Request method failure captured: Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 HTTP/1.1 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixalGGv6tXUtGDSbIqD34-iUuvCC_CYUm1CWvQE8XJXkmceHsa_tNs7mAwOZqStSg7qIW-czJ57Pu6Q-S7s95kuW7jxbRFNbxHGdmw0Cgi9eFcglvCkI23ppXZ_Cacda2VyJ23qEjO5DDH2J2RjOQdeiv4GG0uG3s4n03dZgAZMZo0p4 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:31:44.906469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e9fb04db8ac9464086cd7f3362e97455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: e9fb04db8ac9464086cd7f3362e97455 Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1362045638 Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 68676523b99247bf8f5b9a7553e67f26 Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1362045638-project Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.908116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'a347082e-a86f-46f0-a018-e3918e3e8262'} Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:31:44.908898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. Jul 06 15:31:44.910276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:31:44.911459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] Returning 404 to user: Instance a347082e-a86f-46f0-a018-e3918e3e8262 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:31:44.911459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c73a40a7-7c7e-49e9-b1e8-2a3daf615a81 tempest-AttachVolumeNegativeTest-1362045638 tempest-AttachVolumeNegativeTest-1362045638-project] 10.222.0.46 "GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262" status: 404 len: 111 microversion: 2.1 time: 0.029239 Jul 06 15:31:44.911459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 454/867] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:44 2022] GET /compute/v2.1/servers/a347082e-a86f-46f0-a018-e3918e3e8262 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:31:45.259394 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:45.260048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:45.266016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:45.266458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:45.267209 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:45.267730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:45.477931 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:45.485813 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:45.487338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:45.488497 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-83750042-4c71-415c-9313-52687ac80f6f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.233063 Jul 06 15:31:45.489043 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 414/868] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:45 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:46.506911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:46.507548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:46.515350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:46.515457 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:46.516298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:46.516966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:46.671521 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:46.682091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:46.685199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:46.686719 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b24f5ffe-fccb-41ca-be6a-5963f92d1585 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.184452 Jul 06 15:31:46.699383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 455/869] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:46 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:47.706302 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:47.706956 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:47.715153 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:47.715655 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:47.716442 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:47.717239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:47.911958 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:47.923789 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:47.925774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:47.936314 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-68f3e9bb-4d61-4cc1-9969-19320723763e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.234441 Jul 06 15:31:47.937935 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 415/870] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:47 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:48.954995 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:48.955662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:48.962711 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:48.963157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:48.963942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:48.964372 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:49.113399 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:49.123375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:49.124908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:49.126105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7c0d9322-967d-4786-9692-ff295f4a1387 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.175159 Jul 06 15:31:49.126863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 456/871] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:48 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:50.145264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:50.145873 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:50.153075 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:50.153452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:50.154209 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:50.154815 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:50.315525 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:50.325885 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:50.328279 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:50.331169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9c674118-da1f-4f4e-bdd1-8ea9db280cb7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.190453 Jul 06 15:31:50.332210 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 416/872] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:50 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:51.349520 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:51.350049 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:51.356464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:51.356893 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:51.357651 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:51.358077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:51.487710 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:51.496420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:51.497932 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:51.499083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-91e4c2af-6b01-4cda-824e-ba58cb6e97f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.153610 Jul 06 15:31:51.499670 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 457/873] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:51 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:51.651380 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-13faa3c4-1b0e-45e7-8645-26d53359dc48 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449c1f2b80>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:51.697922 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-13faa3c4-1b0e-45e7-8645-26d53359dc48 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/88f197ae-8ccf-4d47-a079-8506d13a5ccd" status: 200 len: 351 microversion: 2.1 time: 0.050524 Jul 06 15:31:51.698479 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 417/874] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:51 2022] GET /compute/v2.1/os-volumes/88f197ae-8ccf-4d47-a079-8506d13a5ccd => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:52.517325 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:52.517873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:52.525012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:52.525453 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:52.526202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:52.526630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:52.660462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:52.668624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:52.670145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:52.671365 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f6be36aa-3e08-4e3a-8419-227caf7928fb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.158009 Jul 06 15:31:52.671955 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 458/875] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:52 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:53.014970 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e46d3920-8ffe-485c-8c19-9f934f1ddb99 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449c370dc0>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:53.064235 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e46d3920-8ffe-485c-8c19-9f934f1ddb99 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f7ff7ed0-7489-46ab-9efd-0ccc03c4c441" status: 200 len: 350 microversion: 2.1 time: 0.053376 Jul 06 15:31:53.064908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 418/876] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:53 2022] GET /compute/v2.1/os-volumes/f7ff7ed0-7489-46ab-9efd-0ccc03c4c441 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:53.690133 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:53.690812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:53.698045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:53.698788 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:53.699851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:53.700269 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:53.836357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:53.845678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:53.847278 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:53.848640 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e1c9acee-b90c-4e65-a6a0-d62b8e0f692e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.162543 Jul 06 15:31:53.849265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 459/877] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:53 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:54.412993 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7bd613b0-3cbf-4df1-83a2-c5710b99eba6 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449c46b160>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.457724 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7bd613b0-3cbf-4df1-83a2-c5710b99eba6 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1e4eea11-0fda-49ba-96ef-e3897263c920" status: 200 len: 351 microversion: 2.1 time: 0.049543 Jul 06 15:31:54.458287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 419/878] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes/1e4eea11-0fda-49ba-96ef-e3897263c920 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:54.469538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b16c7d8-f651-41e4-a605-0d15b6baf79c tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449cc2fb80>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.551504 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b16c7d8-f651-41e4-a605-0d15b6baf79c tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085576 Jul 06 15:31:54.552078 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 460/879] 10.222.0.46 () {58 vars in 1133 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:54.563981 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9eeaf3d2-0bef-4db7-931c-0dad68dd6a8a tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449c2bd790>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.643377 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9eeaf3d2-0bef-4db7-931c-0dad68dd6a8a tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083051 Jul 06 15:31:54.644192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 420/880] 10.222.0.46 () {58 vars in 1148 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:31:54.656378 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-254bd379-b7eb-4056-b679-71e91e737d99 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449cbea310>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.736740 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-254bd379-b7eb-4056-b679-71e91e737d99 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084000 Jul 06 15:31:54.737314 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 461/881] 10.222.0.46 () {58 vars in 1133 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:54.748812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-80f0429a-bc16-4548-9f09-a8f686526785 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449c2bd820>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.839255 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-80f0429a-bc16-4548-9f09-a8f686526785 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094256 Jul 06 15:31:54.840002 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 421/882] 10.222.0.46 () {58 vars in 1166 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:54.851688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-58079d14-3e8b-4b4f-9d05-d16550ec5ef9 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449cbd5670>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.867265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:54.868427 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:54.877153 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:54.877798 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:54.879548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:54.881151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:54.956107 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-58079d14-3e8b-4b4f-9d05-d16550ec5ef9 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.108403 Jul 06 15:31:54.959272 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 462/883] 10.222.0.46 () {58 vars in 1169 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:31:54.969741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0af19f88-60fe-4d6c-b22d-0e989fd9c766 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449cbeadc0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:55.028530 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:55.032170 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:55.037921 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:55.039637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:55.040867 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4a0a6315-1cc2-40f7-b4ce-51be83ec9b91 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1743 microversion: 2.20 time: 0.177623 Jul 06 15:31:55.041518 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 422/884] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:31:55.051355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0af19f88-60fe-4d6c-b22d-0e989fd9c766 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085421 Jul 06 15:31:55.052679 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 463/885] 10.222.0.46 () {58 vars in 1154 bytes} [Wed Jul 6 15:31:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:55.063512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-484d7280-cece-44ed-a072-de4285765b34 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449c1f2e50>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:55.156005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-484d7280-cece-44ed-a072-de4285765b34 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096037 Jul 06 15:31:55.156569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 423/886] 10.222.0.46 () {58 vars in 1187 bytes} [Wed Jul 6 15:31:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:31:55.168632 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-930fafa9-d8fe-42bf-a3b5-7a86774df014 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] Calling method '.version_select at 0x7f449cbcfd30>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:55.249966 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-930fafa9-d8fe-42bf-a3b5-7a86774df014 tempest-VolumesTestJSON-494554130 tempest-VolumesTestJSON-494554130-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085046 Jul 06 15:31:55.250679 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 464/887] 10.222.0.46 () {58 vars in 1154 bytes} [Wed Jul 6 15:31:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:31:56.059600 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:56.060375 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:56.066502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:56.066952 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:56.067747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:56.068180 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:56.100814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:56.101665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:56.114039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:56.114635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:56.117651 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:56.118100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:56.122179 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:56.144366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lazy-loading 'flavor' on Instance uuid 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:31:56.215409 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:56.222747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6fc8d83e-185b-4c1b-9d80-f0b6f91efde6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "POST /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825/action" status: 202 len: 0 microversion: 2.1 time: 0.128543 Jul 06 15:31:56.223544 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 465/888] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:31:56 2022] POST /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:31:56.224637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:56.226164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:56.227632 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d1ec1810-bd1d-4ced-b85a-99a0f916ea62 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1743 microversion: 2.20 time: 0.172103 Jul 06 15:31:56.228190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 424/889] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:56 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:56.236295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:56.236998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:56.244294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:56.244755 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:56.245560 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:56.245994 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:56.383411 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:56.391647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-96fb878b-c582-4084-b00f-a4ceec0b8151 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.159460 Jul 06 15:31:56.392228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 466/890] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:56 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:31:57.252610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:57.253316 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:57.267250 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:57.267715 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:57.268506 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:57.268951 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:57.409900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:57.411141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:57.422188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:57.422857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:57.423924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:57.424364 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:57.455353 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:57.469246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:57.473699 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:57.475689 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9276ce65-0b33-415e-9c20-219395134808 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.233283 Jul 06 15:31:57.476569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 425/891] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:57 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:57.616663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:57.624670 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2e6836a0-24fe-49f7-8e8a-432899edeb6d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.218768 Jul 06 15:31:57.625250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 467/892] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:57 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:31:57.919865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-90320b9c-865a-4fee-81cc-913f926542cd req-68c2f728-596f-4d8f-9269-33eba4eb3b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "name": "network-vif-plugged", "status": "completed", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:31:57.938569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-90320b9c-865a-4fee-81cc-913f926542cd req-68c2f728-596f-4d8f-9269-33eba4eb3b68 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:57.939567 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-90320b9c-865a-4fee-81cc-913f926542cd req-68c2f728-596f-4d8f-9269-33eba4eb3b68 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:57.955306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-90320b9c-865a-4fee-81cc-913f926542cd req-68c2f728-596f-4d8f-9269-33eba4eb3b68 service nova] Creating event network-vif-plugged:a3380706-64df-4d3c-b081-f2075be880fa for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 on hv-cinder-84884 Jul 06 15:31:57.961469 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-90320b9c-865a-4fee-81cc-913f926542cd req-68c2f728-596f-4d8f-9269-33eba4eb3b68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046421 Jul 06 15:31:57.964302 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 426/893] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:31:58.496726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:58.497383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:58.504289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:58.504811 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:58.506166 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:58.506665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:58.645370 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:58.651522 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:58.657797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:58.668664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:58.674046 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:58.675858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:58.677650 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:58.677878 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d68bc949-ec87-4d74-9782-de30989da86a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.186928 Jul 06 15:31:58.679516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 468/894] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:58 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:31:58.679984 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:58.680574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:58.854442 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:58.865119 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e64704a0-7437-4f64-8ecc-af8397b78dd6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.224983 Jul 06 15:31:58.867117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 427/895] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:58 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:31:59.697306 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:59.698011 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:59.704716 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:59.705361 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:59.706307 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:59.706954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:59.887579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:31:59.889017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:31:59.891578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=41 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:59.903601 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:59.904055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:59.905089 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:31:59.911104 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:31:59.915199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:59.923885 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:59.925424 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:31:59.928424 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0d4756ce-7c4c-4c0b-ad8d-13b96f3e3a48 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.235928 Jul 06 15:31:59.929968 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 469/896] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:31:59 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:00.095547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:00.120274 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-85717a44-82e5-43d3-8c2b-7beb949d2fd4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.237477 Jul 06 15:32:00.122343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 428/897] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:31:59 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:00.948589 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:00.950036 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:00.957815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:00.958959 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:00.960027 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:00.960681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:01.105621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:01.115147 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:01.117508 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:01.118883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9b0119ab-afe7-4943-900e-9931a332097d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.174691 Jul 06 15:32:01.129585 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 470/898] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:00 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:01.140772 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:01.141570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:01.148591 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:01.149097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:01.149876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:01.150300 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:01.316240 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:01.325138 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0d11a7c4-7887-40c9-9bf3-a148a539fcf8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.188273 Jul 06 15:32:01.325982 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 429/899] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:01 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:02.136977 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:02.137775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:02.144375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:02.144889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:02.146228 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:02.146762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:02.294752 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:02.302780 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:02.304619 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:02.306034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e7f9431c-7014-4479-bb11-9f7b9750ec97 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.172926 Jul 06 15:32:02.306749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 471/900] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:02 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:02.341850 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:02.342579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:02.349464 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:02.350137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:02.350899 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:02.351371 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:02.539360 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:02.550030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d08e2082-ff8b-4e60-86b3-3e8696dfe4c8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.211767 Jul 06 15:32:02.556293 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 430/901] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:02 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:03.324854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:03.325459 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:03.332381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:03.333546 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:03.334698 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:03.335439 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:03.487751 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:03.496560 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:03.498294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:03.499735 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6c72de0e-82a5-46cb-ac93-52a7a237e748 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.178915 Jul 06 15:32:03.500526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 472/902] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:03 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:03.573292 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:03.573917 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:03.581736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:03.582475 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:03.583581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:03.584013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:03.739540 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:03.747347 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ac1c9661-347b-49d1-b290-893f27e41664 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.178875 Jul 06 15:32:03.757763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 431/903] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:03 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:04.519681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:04.520291 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:04.527722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:04.528359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:04.529341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:04.529778 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:04.669873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:04.678865 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:04.680422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:04.681783 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6e2ea0c6-3199-489d-8cbb-fa4ce0a13a74 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.167412 Jul 06 15:32:04.682348 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 473/904] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:04 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:04.764899 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:04.765496 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:04.772362 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:04.773249 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:04.774211 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:04.774640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:04.918988 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:04.926870 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-236200e1-b93d-4aa5-964a-e6459d2f4d0d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.165753 Jul 06 15:32:04.927759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 432/905] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:04 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:05.704237 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:05.704976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:05.713009 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:05.713453 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:05.714217 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:05.714647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:05.874178 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:05.883805 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:05.885875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:05.887298 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-958a9c7d-644b-4b08-ab5a-150b5eb2b034 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1738 microversion: 2.20 time: 0.187063 Jul 06 15:32:05.888070 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 474/906] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:05 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:05.945036 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:05.945779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:05.953217 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:05.953876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:05.954831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:05.955289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:06.106214 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:06.114177 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f50e4f20-51a8-4b43-92ff-85bce121c7a7 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.173792 Jul 06 15:32:06.114933 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 433/907] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:05 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:06.907009 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:06.907741 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:06.915573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:06.916489 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:06.917260 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:06.917694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:07.054814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:07.062800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:07.064351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:07.065528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a65726a2-7683-483c-aa61-6232fabfe54b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1720 microversion: 2.20 time: 0.162534 Jul 06 15:32:07.066086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 475/908] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:06 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:07.131005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:07.131685 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:07.138051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:07.138505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:07.139280 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:07.139719 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:07.335865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:07.343942 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8bd80231-4d68-4d30-a0be-f2e7ec67bbcb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.216282 Jul 06 15:32:07.344124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 434/909] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:07 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:08.087580 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:08.088192 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:08.094617 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:08.095062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:08.095976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:08.096405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:08.232118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:08.241289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:08.243188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:08.244461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0f7d9df5-4786-42a8-8f06-bce154caa1f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1720 microversion: 2.20 time: 0.164933 Jul 06 15:32:08.256240 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 476/910] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:08 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:08.360973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:08.361575 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:08.368666 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:08.369110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:08.369860 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:08.370286 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:08.502155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:08.509949 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a38b57c0-0f4c-46c1-8846-8e82008317ed tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.152869 Jul 06 15:32:08.510518 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 435/911] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:08 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:09.261759 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:09.262360 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:09.265352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:09.271801 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.272281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.273329 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.273755 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.407035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:09.414831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:09.416373 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:09.417523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-22d96ffd-c1ce-4cf4-ba65-f43730a26dd7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1663 microversion: 2.20 time: 0.159627 Jul 06 15:32:09.418087 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 477/912] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:09 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:09.435429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "231d7127-37a2-4135-8fe7-a6629c288da5"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:09.436651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:09.443600 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.444038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.444785 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.445212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.526629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:09.527249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:09.539972 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.540571 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.541649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.542290 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.702131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:09.715437 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-78f62398-f10c-49d6-83db-e8cee31a4352 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.192682 Jul 06 15:32:09.716015 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 478/913] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:09 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:09.786605 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-04441648-679b-406e-aaa3-49ea1416f84f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354686 Jul 06 15:32:09.787235 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 436/914] 10.222.0.46 () {62 vars in 1363 bytes} [Wed Jul 6 15:32:09 2022] POST /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:32:09.881689 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-bc7cba30-cf0a-4818-8a56-5543e57da674 req-37f3b426-dc4c-4ab5-8d26-5463dd21c3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "name": "network-vif-unplugged", "status": "completed", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:09.903988 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-bc7cba30-cf0a-4818-8a56-5543e57da674 req-37f3b426-dc4c-4ab5-8d26-5463dd21c3a9 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.904505 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-bc7cba30-cf0a-4818-8a56-5543e57da674 req-37f3b426-dc4c-4ab5-8d26-5463dd21c3a9 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.905777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:09.906610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:09.915718 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.916875 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.917882 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:09.918342 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.compute.server_external_events [req-bc7cba30-cf0a-4818-8a56-5543e57da674 req-37f3b426-dc4c-4ab5-8d26-5463dd21c3a9 service nova] Unable to find a host for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7. Dropping event network-vif-unplugged {{(pid=117619) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 06 15:32:09.918660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:09.919337 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-bc7cba30-cf0a-4818-8a56-5543e57da674 req-37f3b426-dc4c-4ab5-8d26-5463dd21c3a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042686 Jul 06 15:32:09.919946 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 479/915] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 06 15:32:09.994241 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:10.020580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-047513c5-e84a-474b-9275-3536580893b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/action" status: 202 len: 0 microversion: 2.20 time: 0.120162 Jul 06 15:32:10.024648 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 437/916] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jul 6 15:32:09 2022] POST /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:32:10.029688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:10.030307 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:10.037353 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:10.037830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:10.038739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:10.039202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:10.057009 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:10.180596 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:10.188890 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:10.190406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:10.191592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-95da39c4-08f1-4236-8539-99861b1ee7d2 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1749 microversion: 2.20 time: 0.165902 Jul 06 15:32:10.192373 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 480/917] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:10 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:32:10.733485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:10.734094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:10.741011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:10.741643 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:10.742412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:10.742845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:10.886282 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:10.893810 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-30ce75e8-7803-4eb5-b304-c3076947d7ef tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.164700 Jul 06 15:32:10.894546 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 438/918] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:10 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:11.209492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:11.210093 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:11.216629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:11.217076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:11.217821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:11.218256 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:11.346923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:11.356680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:11.358186 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:11.359620 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-599e7a28-31c1-4f5d-88c8-f1f09168fe35 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1751 microversion: 2.20 time: 0.154020 Jul 06 15:32:11.360436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 481/919] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:11 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:11.911808 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:11.912424 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:11.919331 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:11.920106 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:11.921152 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:11.921604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:12.209820 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:12.218620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b124024a-070a-4afd-912e-995725f25c82 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.310940 Jul 06 15:32:12.228073 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 439/920] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:11 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:12.379455 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:12.380819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:12.387484 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:12.387923 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:12.388674 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:12.389134 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:12.519188 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:12.527918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:12.529506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:12.530666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3c4b6059-1e49-4987-b754-590bd4e24d20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.155147 Jul 06 15:32:12.531267 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 482/921] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:12 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:13.235726 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:13.236329 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:13.242795 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:13.243254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:13.244025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:13.244441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:13.423777 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:13.432442 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a04f52d2-6781-47ad-b2a8-21462c3c9eb8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.200532 Jul 06 15:32:13.433072 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 440/922] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:13 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:13.548887 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:13.549338 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:13.556075 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:13.556421 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:13.557181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:13.557615 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:13.695631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:13.704842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:13.706559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:13.708612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b4fb06a-dbb1-4df3-b953-209f1caa52f4 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.163664 Jul 06 15:32:13.719122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 483/923] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:13 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:14.450583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:14.452282 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:14.461381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.462412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.464425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.465164 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.629118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:14.649276 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-44a2b8cb-c8f1-493a-b95d-2cb52712a5e4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1570 microversion: 2.1 time: 0.201762 Jul 06 15:32:14.649878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 441/924] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:14 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:14.668673 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:14.669253 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:14.678576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.679033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.679841 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.692045 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.726482 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:14.727230 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:14.742114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.742573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.743411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.743854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.827954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-58484f40-1c4d-493d-a04f-2550ddbba3c1 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "POST /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825/action" status: 202 len: 0 microversion: 2.1 time: 0.163093 Jul 06 15:32:14.830676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 484/925] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 6 15:32:14 2022] POST /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:32:14.843309 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:14.845208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:14.862888 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.864762 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.868664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:14.869138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:14.977829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:14.989042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:14.996195 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:14.997750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2b66911b-cd76-4ec7-887a-88883387872e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.275730 Jul 06 15:32:15.012702 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 442/926] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:14 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:15.151250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:15.161155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a46552e0-2924-46d1-adfa-1782c592b1fc tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1578 microversion: 2.1 time: 0.326873 Jul 06 15:32:15.187500 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 485/927] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:14 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1578 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:16.019887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:16.020626 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:16.027650 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:16.028101 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:16.028871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:16.029305 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:16.179534 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:16.180147 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:16.181858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:16.190829 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:16.191055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:16.191323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:16.192158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:16.192594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:16.193092 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:16.194371 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c396f1d1-7ea8-4abb-9d13-45f684eaf5dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.178677 Jul 06 15:32:16.195263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 443/928] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:16 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:16.351022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:16.361766 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1f862b62-9401-4e6c-89a8-de0253c64fbe tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1578 microversion: 2.1 time: 0.186703 Jul 06 15:32:16.362359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 486/929] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:16 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:17.213625 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:17.214245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:17.220990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:17.221467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:17.222269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:17.222760 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:17.383845 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:17.385267 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:17.394614 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:17.395807 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:17.396674 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:17.397181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:17.452296 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:17.467343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:17.474199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:17.477491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e63f7229-f188-49f9-8ca2-b4434bbe1892 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.267118 Jul 06 15:32:17.491082 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 444/930] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:17 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:17.612239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:17.621483 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d1500b2d-3803-4d37-bbb9-9a9de4bb2f2f tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1578 microversion: 2.1 time: 0.241822 Jul 06 15:32:17.626281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 487/931] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:17 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:17.900194 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-2e63055a-bc49-40c9-beb9-62659f15b4ab req-91288597-d0d4-46de-a7de-f16a3750a829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "name": "network-vif-unplugged", "status": "completed", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:17.915948 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-2e63055a-bc49-40c9-beb9-62659f15b4ab req-91288597-d0d4-46de-a7de-f16a3750a829 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:17.919110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-2e63055a-bc49-40c9-beb9-62659f15b4ab req-91288597-d0d4-46de-a7de-f16a3750a829 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:17.937474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-2e63055a-bc49-40c9-beb9-62659f15b4ab req-91288597-d0d4-46de-a7de-f16a3750a829 service nova] Creating event network-vif-unplugged:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:32:17.944308 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-2e63055a-bc49-40c9-beb9-62659f15b4ab req-91288597-d0d4-46de-a7de-f16a3750a829 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050000 Jul 06 15:32:17.948065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 445/932] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:32:18.497590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:18.498726 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:18.506140 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:18.506665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:18.507592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:18.508097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:18.646265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:18.646955 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:18.656746 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:18.657190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:18.657966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:18.658404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:18.709422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:18.720204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:18.721775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:18.723511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-17eef61e-8022-4c29-954a-2d005e38b1bd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.229285 Jul 06 15:32:18.724022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 488/933] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:18 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:18.834894 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:18.846191 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4fec02d9-a9d8-42f1-8b8f-5a5dd01429fb tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1578 microversion: 2.1 time: 0.204618 Jul 06 15:32:18.846784 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 446/934] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:18 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:19.742552 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:19.743155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:19.749426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:19.749810 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:19.750569 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:19.751184 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:19.864459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:19.865064 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:19.871991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:19.872881 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:19.874038 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:19.874640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:20.102553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:20.113326 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-45d495dd-06ac-40bf-a659-4665b02315d6 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1578 microversion: 2.1 time: 0.253140 Jul 06 15:32:20.116093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 447/935] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:19 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1578 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:20.131814 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:20.141559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:20.143073 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:20.144276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2cf00755-9a6b-405f-98a0-045673ab280f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.406369 Jul 06 15:32:20.145378 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 489/936] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:19 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:21.136614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:21.137248 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:21.144895 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:21.145349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:21.146343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:21.146937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:21.173033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:21.173644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:21.188114 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:21.188567 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:21.189346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:21.189775 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:21.362285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:21.374705 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:21.376619 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:21.378320 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8a3acd2f-92cf-42e1-a676-3404dd66980d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.219132 Jul 06 15:32:21.379553 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 490/937] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:21 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:32:21.486545 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:21.494123 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4396dcc9-be15-42cf-bee6-bdc7718bffd2 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1578 microversion: 2.1 time: 0.361670 Jul 06 15:32:21.494932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 448/938] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:21 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1578 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:22.397385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:22.399195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:22.406086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:22.409548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:22.409548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:22.409548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:22.512699 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:22.513322 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:22.520915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:22.521480 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:22.522434 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:22.523798 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:22.565912 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:22.575086 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:22.576643 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:22.577817 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-aa59ccec-53b6-41d5-927f-1d4627afaa04 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.185205 Jul 06 15:32:22.578418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 491/939] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:22 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:22.673990 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:22.682279 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a9ce0965-ac24-4a4c-bd6b-26d67c34496e tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1520 microversion: 2.1 time: 0.174395 Jul 06 15:32:22.682848 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 449/940] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:22 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:23.596091 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:23.596689 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:23.604197 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:23.604648 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:23.605425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:23.605856 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:23.700694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:23.701234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:23.708544 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:23.709022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:23.709781 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:23.710403 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:23.744066 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:23.752339 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:23.753842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:23.755033 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-78649b93-89d5-4f9b-be64-65a86d5250cd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.162876 Jul 06 15:32:23.755639 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 492/941] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:23 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:23.898909 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:23.906404 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ad11b207-ccad-43a6-b781-d4a9ccfe4643 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.209617 Jul 06 15:32:23.906976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 450/942] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:23 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:24.773211 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:24.773749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:24.780135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:24.780577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:24.781330 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:24.781759 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:24.907794 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:24.916621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:24.918135 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:24.919315 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-64b4e14d-8ee7-4ad9-8398-e1d2d7a3238e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.150301 Jul 06 15:32:24.920083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 493/943] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:24 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:24.924124 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:24.924731 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:24.931688 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:24.932125 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:24.932871 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:24.933295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:25.060899 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:25.068246 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d48fe09e-db8b-4ffd-b56b-8e79851b81c4 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.147917 Jul 06 15:32:25.068802 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 451/944] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:24 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:25.938204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:25.938764 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:25.945860 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:25.946305 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:25.947064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:25.947522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:26.073893 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:26.082533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:26.084103 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:26.085061 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:26.085543 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c468901a-682f-4e58-8614-0a42955de837 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.151170 Jul 06 15:32:26.085679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:26.086335 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 494/945] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:25 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:26.092360 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:26.092829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:26.093577 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:26.094013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:26.227265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:26.234735 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9e45ad04-0ceb-4dbc-a115-391072e57f58 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.153531 Jul 06 15:32:26.235324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 452/946] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:26 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:27.104268 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:27.104796 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:27.111241 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:27.111714 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:27.112473 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:27.112911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:27.242557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:27.251138 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:27.252690 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:27.252836 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:27.253805 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:27.254421 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-77c5fe06-7312-49a4-8305-3b9ff08c3f8a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.154274 Jul 06 15:32:27.254889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 495/947] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:27 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:27.260820 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:27.261335 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:27.262177 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:27.262673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:27.390706 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:27.398532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-db38cbdf-547e-402e-93ed-40d644f50b5b tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.149766 Jul 06 15:32:27.399195 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 453/948] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:27 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:28.273422 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:28.274018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:28.281143 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:28.281628 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:28.282526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:28.282993 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:28.286869 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:28.410778 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:28.416084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:28.416691 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:28.422122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:28.423183 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:28.423656 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:28.423766 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:28.424409 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:28.424839 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:28.424952 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8af3041f-3890-4d5d-81bb-b3dda01a2cf9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.156258 Jul 06 15:32:28.425411 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 496/949] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:28 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:28.567799 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:28.571256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:28.576517 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2c6f74f2-7b17-439f-92e9-8b52fa913a66 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.164878 Jul 06 15:32:28.577080 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 454/950] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:28 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:29.443239 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:29.443852 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:29.451682 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:29.452156 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:29.452915 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:29.453354 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:29.583986 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:29.592349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:29.593674 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:29.594127 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:29.594400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:29.594996 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-21cab6ed-b8b4-45f8-846b-28305ffef9d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.155881 Jul 06 15:32:29.595593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 497/951] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:29 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:29.602277 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:29.602722 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:29.603514 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:29.603968 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:29.731417 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:29.738701 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f0dd37bd-b9a7-43fa-aa16-3fbc5d5fe550 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.148842 Jul 06 15:32:29.739283 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 455/952] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:29 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:30.613777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:30.614507 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:30.621062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:30.621518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:30.622287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:30.622724 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:30.752989 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:30.755077 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:30.755737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:30.761957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=58 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:30.762120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:30.763574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:30.764590 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:30.765108 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7ceab604-f856-4419-93f4-9d9732c4c6dc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.155684 Jul 06 15:32:30.765256 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:30.765681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 498/953] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:30 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:30.766020 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:30.766532 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:30.946714 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:30.954287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-25ceaa84-7843-4f22-a952-26b13b73087a tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.203046 Jul 06 15:32:30.954912 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 456/954] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:30 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:31.783162 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:31.784021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:31.791034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:31.791323 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:31.792122 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:31.792562 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:31.930310 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:31.939416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:31.941040 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:31.942987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-64bf34db-46a3-43dc-81db-d43ebc84faeb tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.164263 Jul 06 15:32:31.943669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 499/955] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:31 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:31.972066 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:31.972795 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:31.979872 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:31.980397 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:31.981330 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:31.981837 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:32.132073 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:32.140411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9fce8cd1-bd8c-4628-9dca-7b9117eabb24 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.172666 Jul 06 15:32:32.141536 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 457/956] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:31 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:32.152209 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-e14484df-73e2-4488-ac53-e99659f75476 req-a4b9329a-fa76-4b69-8f65-60264ff9ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "name": "network-vif-plugged", "status": "completed", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:32.163160 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e14484df-73e2-4488-ac53-e99659f75476 req-a4b9329a-fa76-4b69-8f65-60264ff9ad44 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:32.163647 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e14484df-73e2-4488-ac53-e99659f75476 req-a4b9329a-fa76-4b69-8f65-60264ff9ad44 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:32.176987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-e14484df-73e2-4488-ac53-e99659f75476 req-a4b9329a-fa76-4b69-8f65-60264ff9ad44 service nova] Creating event network-vif-plugged:a3380706-64df-4d3c-b081-f2075be880fa for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 on hv-cinder-84884 Jul 06 15:32:32.182252 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-e14484df-73e2-4488-ac53-e99659f75476 req-a4b9329a-fa76-4b69-8f65-60264ff9ad44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043597 Jul 06 15:32:32.183089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 500/957] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:32:32.961610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:32.962470 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:32.969018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:32.969474 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:32.970221 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:32.970652 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:33.106848 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:33.116338 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:33.117850 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:33.119005 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f3428eb8-3177-42c3-ba19-eb8ffe4ed2aa tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.161689 Jul 06 15:32:33.119581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 458/958] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:32 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:33.158708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:33.159431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:33.166042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:33.166487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:33.167264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:33.167819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:33.306720 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:33.314962 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6a3d1338-31ae-4f9f-b31b-f36beabfdc01 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.160813 Jul 06 15:32:33.315609 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 501/959] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:33 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:34.137243 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:34.138030 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:34.144740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:34.145187 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:34.145951 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:34.146381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:34.207104 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-7e2904d0-11c9-421d-baf2-1adb9b302e12 req-ba6de97b-6a9c-4a2d-a6b0-2e0a7dd06015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "name": "network-vif-plugged", "status": "completed", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:34.215865 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-7e2904d0-11c9-421d-baf2-1adb9b302e12 req-ba6de97b-6a9c-4a2d-a6b0-2e0a7dd06015 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:34.216383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-7e2904d0-11c9-421d-baf2-1adb9b302e12 req-ba6de97b-6a9c-4a2d-a6b0-2e0a7dd06015 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:34.229400 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-7e2904d0-11c9-421d-baf2-1adb9b302e12 req-ba6de97b-6a9c-4a2d-a6b0-2e0a7dd06015 service nova] Creating event network-vif-plugged:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:32:34.240974 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-7e2904d0-11c9-421d-baf2-1adb9b302e12 req-ba6de97b-6a9c-4a2d-a6b0-2e0a7dd06015 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037459 Jul 06 15:32:34.241739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 502/960] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:32:34.304535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:34.313319 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:34.314831 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:34.316014 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-195c1828-a609-40ba-aa49-bd751025a512 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1807 microversion: 2.20 time: 0.182975 Jul 06 15:32:34.317161 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 459/961] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:34 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:34.333054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:34.333894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:34.340625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:34.341286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:34.342343 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:34.342868 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:34.482896 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:34.491208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-28085116-41cd-4f80-89a0-7a78165c99f3 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.162912 Jul 06 15:32:34.491961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 503/962] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:34 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:32:35.337146 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:35.338526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:35.345110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:35.345622 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:35.346452 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:35.346967 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:35.480498 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:35.491003 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:35.492568 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:35.493726 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d40e5ee3-05f3-4f40-9869-d3dfa9c6cafe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1794 microversion: 2.20 time: 0.163581 Jul 06 15:32:35.494288 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 460/963] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:32:35 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:32:35.509558 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:35.510210 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:35.516181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:35.516630 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:35.517385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:35.517813 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:35.665016 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:35.670516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-87f628ff-3805-445b-9ee8-ebcbe8004f8d tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1576 microversion: 2.1 time: 0.164972 Jul 06 15:32:35.671148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 504/964] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:35 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:36.688131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:32:36.688661 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:32:36.695461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:36.695908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:36.696671 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:32:36.697107 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:32:36.824907 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:32:36.833454 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-66e607c1-9758-4513-875f-ef10717b70d8 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1563 microversion: 2.1 time: 0.148687 Jul 06 15:32:36.834033 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 461/965] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:32:36 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:32:51.137534 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=57 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:51.139254 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=45 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:51.372616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cb448222-9b49-454a-abb2-6c4a622a6fdd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Action: 'create', calling method: .version_select at 0x7f449cc04ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1567947179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLH+zf8CxcgQDJ8LmZIAqwOgWHS3KrcRrLvm9x433iHQOcjTXFQvFlX5J475zONMwEBaELlKlcLuS70Kmj8L82rHWI88PDrZvu/hImz76MqiKjOz1wAtvwyDwMF/7QthQ=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:32:51.395754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-cb448222-9b49-454a-abb2-6c4a622a6fdd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:32:51.403790 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-cb448222-9b49-454a-abb2-6c4a622a6fdd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for user 7f9e0665a37d490f8b62205c5890da56 and project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:32:51.438369 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cb448222-9b49-454a-abb2-6c4a622a6fdd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.306378 Jul 06 15:32:51.439006 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 505/966] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jul 6 15:32:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:06.515780 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:33:06.516320 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Wed Jul 6 15:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:33:07.622746 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-66894248", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1567947179", "security_groups": [{"name": "tempest-secgroup-smoke-2098609478"}], "block_device_mapping_v2": [{"uuid": "71c3d348-9c74-4f5d-8581-d3dc66afa9b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "784d35cc-1e96-42d9-b35a-63f5c285a35a"}]}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:07.631237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=11 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:07.631904 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=42 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:07.735027 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] validate_networks() for [('784d35cc-1e96-42d9-b35a-63f5c285a35a', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:33:08.088944 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:33:08.089435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:33:08.089853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:33:08.090254 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:33:08.090659 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:33:08.099323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:08.099765 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:08.100548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:08.100976 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:08.117140 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:33:08.121001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for user 7f9e0665a37d490f8b62205c5890da56 and project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:33:08.176600 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:33:08.178752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71c3d348-9c74-4f5d-8581-d3dc66afa9b7',volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:33:08.302202 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0e3645b4-400c-41fa-a5a6-b70fdd8aa7c8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.684121 Jul 06 15:33:08.302900 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 462/967] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:33:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:33:08.310573 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:08.311341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:08.315243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b00fd2fa-0c60-4c05-a43b-04f9a6754de4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:08.315844 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b00fd2fa-0c60-4c05-a43b-04f9a6754de4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:08.369250 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b00fd2fa-0c60-4c05-a43b-04f9a6754de4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:08.376017 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b00fd2fa-0c60-4c05-a43b-04f9a6754de4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1093 microversion: 2.1 time: 0.066846 Jul 06 15:33:08.376581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 506/968] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:08 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:09.393367 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:09.393977 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:09.401565 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:09.402009 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:09.402770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:09.403291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:09.472958 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:09.481016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-89b14097-bccb-43aa-bb7f-c3ba4f1e6bd8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1209 microversion: 2.1 time: 0.091706 Jul 06 15:33:09.481583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 463/969] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:09 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:10.498768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:10.499528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:10.507526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:10.507960 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:10.508783 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:10.509234 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:10.644713 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:10.652679 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cb2b07e9-e4e2-4384-91a1-b8d349e8a409 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.158054 Jul 06 15:33:10.653256 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 507/970] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:10 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:10.831094 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-b225b3df-fc68-4051-a57b-4cb1eb7b81f8 req-00641fa1-b93f-4105-9cd1-9fa3129c6e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c304cb7c-8615-4f10-836c-78b4ae231d57", "tag": "b0ef2a66-9d47-4a02-a75e-4a955b7b7809"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:10.853415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-b225b3df-fc68-4051-a57b-4cb1eb7b81f8 req-00641fa1-b93f-4105-9cd1-9fa3129c6e8c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:10.853876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-b225b3df-fc68-4051-a57b-4cb1eb7b81f8 req-00641fa1-b93f-4105-9cd1-9fa3129c6e8c service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:10.866908 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-b225b3df-fc68-4051-a57b-4cb1eb7b81f8 req-00641fa1-b93f-4105-9cd1-9fa3129c6e8c service nova] Creating event network-changed:b0ef2a66-9d47-4a02-a75e-4a955b7b7809 for instance c304cb7c-8615-4f10-836c-78b4ae231d57 on hv-cinder-84884 Jul 06 15:33:10.872559 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-b225b3df-fc68-4051-a57b-4cb1eb7b81f8 req-00641fa1-b93f-4105-9cd1-9fa3129c6e8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046998 Jul 06 15:33:10.873550 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 464/971] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:11.669861 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:11.670569 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:11.677126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:11.677653 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:11.678420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:11.678858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:11.811722 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:11.819283 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ceab5bc7-1e6c-4f5b-96d2-46e7004d1977 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.153498 Jul 06 15:33:11.819863 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 508/972] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:11 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:12.836580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:12.837813 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:12.844548 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:12.844986 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:12.845761 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:12.846170 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:12.980693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:12.988084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-99f28041-11ab-40c6-b88c-0797a8bd18a9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.155798 Jul 06 15:33:12.988647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 465/973] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:12 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:13.903190 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:13.903787 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:13.910124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:13.910567 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:13.911340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:13.911772 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:13.939184 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-78a00d1d-0630-4151-994f-404aed9be8ec tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments/231d7127-37a2-4135-8fe7-a6629c288da5" status: 200 len: 194 microversion: 2.20 time: 0.040528 Jul 06 15:33:13.939771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 509/974] 10.222.0.46 () {60 vars in 1453 bytes} [Wed Jul 6 15:33:13 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments/231d7127-37a2-4135-8fe7-a6629c288da5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:33:14.002910 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:14.003477 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:14.005064 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:14.005666 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:14.009584 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:14.010033 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:14.010825 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:14.011289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:14.011663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:14.012116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:14.012870 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:14.013299 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:14.093160 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lazy-loading 'services' on Instance uuid 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:33:14.144859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:14.153425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5ca019d9-09c9-4032-a097-a75a9f143f6f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.152133 Jul 06 15:33:14.153941 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 510/975] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:14 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:33:14.163822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-597351e1-3f36-4ae4-afea-9837a359ab64 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments/231d7127-37a2-4135-8fe7-a6629c288da5" status: 202 len: 0 microversion: 2.20 time: 0.164754 Jul 06 15:33:14.164405 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 466/976] 10.222.0.46 () {60 vars in 1456 bytes} [Wed Jul 6 15:33:13 2022] DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments/231d7127-37a2-4135-8fe7-a6629c288da5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:33:14.172701 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:14.173631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:14.179680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:14.180363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:14.181116 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:14.181601 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:14.212288 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5cffbfc3-44de-496c-af61-05779edfde51 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042825 Jul 06 15:33:14.213021 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 511/977] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jul 6 15:33:14 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 15:33:15.171865 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:15.172561 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:15.178821 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.179306 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.180064 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.181047 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.224110 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:15.225034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:15.232073 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.232525 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.233294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.233734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.264410 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-13227f1d-5c19-4946-89f5-8ff7c4ed2102 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044197 Jul 06 15:33:15.265326 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 512/978] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jul 6 15:33:15 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:33:15.313068 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:15.320627 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b155de55-9db4-45cd-bf53-bd0e7779d7f3 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.153572 Jul 06 15:33:15.321292 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 467/979] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:15 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:15.324468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:15.324956 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:15.331044 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.331528 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.332276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.332704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.357385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:33:15.445734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6a3cb1bb-21e7-409c-8ae5-8b9c770f1f30 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 204 len: 0 microversion: 2.20 time: 0.124666 Jul 06 15:33:15.446324 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 513/980] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jul 6 15:33:15 2022] DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 06 15:33:15.454585 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:15.455194 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:15.461350 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.462342 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.463093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:15.463564 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:15.593387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:15.601117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:15.602646 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:15.603840 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f3d4ac91-cf0e-46ff-beeb-1576b417eb27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.153209 Jul 06 15:33:15.604412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 468/981] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:15 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:16.337618 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:16.338321 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:16.344737 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:16.345182 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:16.345942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:16.346380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:16.483755 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:16.491020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e0605a50-5352-41a8-98b2-d0faf9ee8882 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.157595 Jul 06 15:33:16.491624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 514/982] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:16 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:16.622593 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:16.623114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:16.629647 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:16.630073 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:16.630820 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:16.631272 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:16.756998 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:16.764767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:16.766263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:16.767425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3fa4b153-7f7d-49d4-8a77-5179caeb3f3b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.149393 Jul 06 15:33:16.767987 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 469/983] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:16 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:17.508218 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:17.509386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:17.515797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:17.516245 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:17.517018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:17.517496 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:17.645125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:17.652808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e677807a-4ac4-46f7-9ee7-0d2d4170b9b1 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.148498 Jul 06 15:33:17.653376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 515/984] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:17 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:17.786021 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:17.786605 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:17.793569 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:17.794016 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:17.794782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:17.795231 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:17.990573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:17.999184 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:18.000736 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:18.001935 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-dc0b3c51-a926-42b8-a065-9133edcfdc37 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 200 len: 1722 microversion: 2.20 time: 0.219950 Jul 06 15:33:18.002500 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 470/985] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:17 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:18.328579 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-3327110b-dee9-4831-b3e9-ae0bdb5eefd0 req-00f1d1ad-1d40-481b-9997-cd1f8fdd5049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1e795f-7c0a-4f58-ba33-0b43235e9af7", "name": "network-vif-deleted", "tag": "a3380706-64df-4d3c-b081-f2075be880fa"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:18.339611 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3327110b-dee9-4831-b3e9-ae0bdb5eefd0 req-00f1d1ad-1d40-481b-9997-cd1f8fdd5049 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:18.340060 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3327110b-dee9-4831-b3e9-ae0bdb5eefd0 req-00f1d1ad-1d40-481b-9997-cd1f8fdd5049 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:18.355649 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-3327110b-dee9-4831-b3e9-ae0bdb5eefd0 req-00f1d1ad-1d40-481b-9997-cd1f8fdd5049 service nova] Creating event network-vif-deleted:a3380706-64df-4d3c-b081-f2075be880fa for instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 on hv-cinder-84884 Jul 06 15:33:18.362884 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-3327110b-dee9-4831-b3e9-ae0bdb5eefd0 req-00f1d1ad-1d40-481b-9997-cd1f8fdd5049 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044947 Jul 06 15:33:18.363529 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 516/986] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:18.670491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:18.671425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:18.673835 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:18.674555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=6 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:18.682415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:18.682861 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:18.683659 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:18.684093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:18.830446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:18.839535 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-69902014-2656-42ad-8436-6d45366ee2e9 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.174073 Jul 06 15:33:18.840460 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 471/987] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:18 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:19.022208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:19.022940 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:19.024914 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:19.031175 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:19.032142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:19.032454 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:19.032894 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:19.046176 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] HTTP exception thrown: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Request method failure captured: Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 HTTP/1.1 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixaqkSnHbBRpabkdaVFlj51aQJidOoRawPFaNU5UheHsvFQ3HaCqWrt3kJfrC1HTOVBC3bBs5IvDFci4pRq2buEsePLphro3ebMPefj_cJ0D_zcx_bFd-JH4STLQXuVHbdR18ujdTp6i9w3wNWW6R_bpmsel6kZ0lWzKRZ8GwyerGvKY Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:33:19.047897 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 2f35de73cde9436c952e0d5f95e74b8b Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:33:19.049694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '9a1e795f-7c0a-4f58-ba33-0b43235e9af7'} Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:33:19.050570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:33:19.052159 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:19.053420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Returning 404 to user: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:33:19.053420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2c72dfbe-c4c9-487f-bd03-c9c8b8b93803 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 404 len: 111 microversion: 2.20 time: 0.031759 Jul 06 15:33:19.053420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 517/988] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:19 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:33:19.058874 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f639e706-b208-4296-bb82-b3f9beffff10 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '.version_select at 0x7f449c6fd310>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:19.079544 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f639e706-b208-4296-bb82-b3f9beffff10 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379863273" status: 204 len: 0 microversion: 2.20 time: 0.024833 Jul 06 15:33:19.080056 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 472/989] 10.222.0.46 () {60 vars in 1258 bytes} [Wed Jul 6 15:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379863273 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 06 15:33:19.722792 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-533fda7b-9c05-412e-9548-de0b18af31e5 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'create', calling method: .version_select at 0x7f449cb63a60>, body: {"keypair": {"name": "tempest-keypair-332757099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZctV3ZCdy9/d5d+//vrJbD0+1QvyoMya58O1jo1IcbEAQNN4jpkywxKkMYRBb+Xw+YlK2ss1KGfRHGnuQ4OL1Z44H7frUB/78x1MmzrR91fPYqReJr3EeH6lr3iDQT7w=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:19.737559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-533fda7b-9c05-412e-9548-de0b18af31e5 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:33:19.741828 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-533fda7b-9c05-412e-9548-de0b18af31e5 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for user 2f35de73cde9436c952e0d5f95e74b8b and project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:33:19.762952 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-533fda7b-9c05-412e-9548-de0b18af31e5 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044114 Jul 06 15:33:19.763581 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 518/990] 10.222.0.46 () {62 vars in 1199 bytes} [Wed Jul 6 15:33:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 06 15:33:19.856959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:19.858157 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:19.864446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:19.864886 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:19.865813 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:19.866114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:20.008153 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:20.015690 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bfba58c0-3faa-4f04-8a1c-f4738fa3e0c7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.163613 Jul 06 15:33:20.016263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 473/991] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:19 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:20.331487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-03684a5b-f3cc-4447-a891-e2fb445cc395 req-65f67e98-1e95-402f-8037-c7683688ef2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c304cb7c-8615-4f10-836c-78b4ae231d57", "name": "network-vif-plugged", "status": "completed", "tag": "b0ef2a66-9d47-4a02-a75e-4a955b7b7809"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:20.343657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-03684a5b-f3cc-4447-a891-e2fb445cc395 req-65f67e98-1e95-402f-8037-c7683688ef2d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:20.345095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-03684a5b-f3cc-4447-a891-e2fb445cc395 req-65f67e98-1e95-402f-8037-c7683688ef2d service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:20.356759 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-03684a5b-f3cc-4447-a891-e2fb445cc395 req-65f67e98-1e95-402f-8037-c7683688ef2d service nova] Creating event network-vif-plugged:b0ef2a66-9d47-4a02-a75e-4a955b7b7809 for instance c304cb7c-8615-4f10-836c-78b4ae231d57 on hv-cinder-84884 Jul 06 15:33:20.364100 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-03684a5b-f3cc-4447-a891-e2fb445cc395 req-65f67e98-1e95-402f-8037-c7683688ef2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035643 Jul 06 15:33:20.365700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 519/992] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:21.033668 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:21.034273 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:21.042015 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:21.042460 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:21.043283 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:21.043716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:21.046883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2070732805", "imageRef": "71f9d937-ffab-4547-9eb7-51a80f149a68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb1e65c9-bd94-49f0-bb47-fcf1417b4a1b"}], "security_groups": [{"name": "tempest-securitygroup--1953566063"}], "key_name": "tempest-keypair-332757099", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:21.161252 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] validate_networks() for [('bb1e65c9-bd94-49f0-bb47-fcf1417b4a1b', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:33:21.187978 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:21.195488 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ff163443-7a08-422f-ac3e-4efe0df636f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1265 microversion: 2.1 time: 0.165713 Jul 06 15:33:21.196117 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 474/993] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:21 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:21.525634 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:33:21.526131 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:33:21.526516 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:33:21.526920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:33:21.527381 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:33:21.536095 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:21.536538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:21.537328 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:21.537758 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:21.554487 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:33:21.558401 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Getting quotas for user 2f35de73cde9436c952e0d5f95e74b8b and project 848d6c1f478d4dba813663c4c866d8b8. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:33:21.569101 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:33:21.571938 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f9d937-ffab-4547-9eb7-51a80f149a68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:33:21.618558 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eef2138d-9be5-4107-8213-9967836e3fad tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.576397 Jul 06 15:33:21.619205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 520/994] 10.222.0.46 () {62 vars in 1187 bytes} [Wed Jul 6 15:33:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 06 15:33:21.629200 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5ac39d65-a1ac-458c-9142-f0251fa614b3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:21.629806 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5ac39d65-a1ac-458c-9142-f0251fa614b3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:21.682283 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5ac39d65-a1ac-458c-9142-f0251fa614b3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:21.689438 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5ac39d65-a1ac-458c-9142-f0251fa614b3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:21.691091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5ac39d65-a1ac-458c-9142-f0251fa614b3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:21.692053 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5ac39d65-a1ac-458c-9142-f0251fa614b3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1281 microversion: 2.20 time: 0.066789 Jul 06 15:33:21.692611 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 475/995] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:21 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:22.212256 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:22.212867 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:22.219070 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:22.219548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:22.220300 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:22.220736 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:22.353467 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:22.360942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0a8331e5-ccae-4ccf-9b44-abefc2101a7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1452 microversion: 2.1 time: 0.152622 Jul 06 15:33:22.361536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 521/996] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:22 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:22.384093 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:22.386196 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:22.393352 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:22.393792 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:22.394552 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:22.394982 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:22.618973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:22.629065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-65894e6a-1718-4cf8-89d9-109d8af8de83 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1452 microversion: 2.1 time: 0.252097 Jul 06 15:33:22.629807 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 476/997] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:22 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1452 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:33:22.709946 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:22.710559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:22.717270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:22.717800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:22.718568 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:22.719003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:22.802031 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:22.810408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:22.811976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:22.813076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-528cc3ee-6863-4f53-86ea-c46446e49e95 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1339 microversion: 2.20 time: 0.107008 Jul 06 15:33:22.813635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 522/998] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:22 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:23.830312 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:23.830927 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:23.837555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:23.838007 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:23.838787 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:23.839245 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:24.470542 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:24.478788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:24.480400 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:24.481577 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-1d85d512-93c2-4551-b8a8-f55c32a88dfe tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.655203 Jul 06 15:33:24.482137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 477/999] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:23 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:25.236346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-20d19af7-ffc6-422e-9885-d645039213ba req-f7c3fffa-4bd9-4615-80fe-faa956d09c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:25.270843 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-20d19af7-ffc6-422e-9885-d645039213ba req-f7c3fffa-4bd9-4615-80fe-faa956d09c90 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:25.271700 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-20d19af7-ffc6-422e-9885-d645039213ba req-f7c3fffa-4bd9-4615-80fe-faa956d09c90 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:25.283844 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-20d19af7-ffc6-422e-9885-d645039213ba req-f7c3fffa-4bd9-4615-80fe-faa956d09c90 service nova] Creating event network-changed:88c8bb0a-387a-48a4-8c7e-f64217bd737b for instance 163b46c6-bff4-4247-afc3-06617093f4de on hv-cinder-84884 Jul 06 15:33:25.289003 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-20d19af7-ffc6-422e-9885-d645039213ba req-f7c3fffa-4bd9-4615-80fe-faa956d09c90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059817 Jul 06 15:33:25.290753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 523/1000] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:25.499679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:25.500283 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:25.506752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:25.507196 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:25.507996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:25.508422 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:25.800973 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:25.809556 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:25.811067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:25.812202 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-53f2b84e-f305-45e6-95ca-57c4772d1009 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.316510 Jul 06 15:33:25.812759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 478/1001] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:25 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:26.830608 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:26.831921 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:26.839054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:26.839532 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:26.840289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:26.840720 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:26.979181 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:26.987931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:26.989465 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:26.990721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f924b766-fc45-4730-adc0-b4d74f670550 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.164458 Jul 06 15:33:26.991373 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 524/1002] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:26 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:27.304919 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-0d3dc61b-54d6-4bdd-b3e8-5377979c58e7 req-216b7747-3859-4e85-ac88-720197d45b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c304cb7c-8615-4f10-836c-78b4ae231d57", "tag": "b0ef2a66-9d47-4a02-a75e-4a955b7b7809"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:27.313903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0d3dc61b-54d6-4bdd-b3e8-5377979c58e7 req-216b7747-3859-4e85-ac88-720197d45b04 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:27.314348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-0d3dc61b-54d6-4bdd-b3e8-5377979c58e7 req-216b7747-3859-4e85-ac88-720197d45b04 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:27.327757 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-0d3dc61b-54d6-4bdd-b3e8-5377979c58e7 req-216b7747-3859-4e85-ac88-720197d45b04 service nova] Creating event network-changed:b0ef2a66-9d47-4a02-a75e-4a955b7b7809 for instance c304cb7c-8615-4f10-836c-78b4ae231d57 on hv-cinder-84884 Jul 06 15:33:27.332679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-0d3dc61b-54d6-4bdd-b3e8-5377979c58e7 req-216b7747-3859-4e85-ac88-720197d45b04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031416 Jul 06 15:33:27.333321 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 479/1003] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:28.009555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:28.010216 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:28.016672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:28.017119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:28.017873 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:28.018306 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:28.144377 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:28.152402 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:28.153904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:28.154999 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-86fb8670-93fc-40d6-88f8-3803c5d62b2d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.149962 Jul 06 15:33:28.155585 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 525/1004] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:28 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:29.174710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:29.175458 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:29.181393 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:29.181832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:29.182578 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:29.183003 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:29.311490 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:29.319309 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:29.320822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:29.321921 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-db9a83f2-141d-41b2-96ee-63a6ff29c150 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.152302 Jul 06 15:33:29.322505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 480/1005] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:29 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:30.340584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:30.341226 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:30.347958 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:30.348418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:30.349194 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:30.349626 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:30.353856 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:30.370630 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-f5ba4399-3265-4ba4-bd6f-170978a2385a req-7339be52-bbfe-493f-b1e2-657bfa027aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "name": "network-vif-plugged", "status": "completed", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:30.381061 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-f5ba4399-3265-4ba4-bd6f-170978a2385a req-7339be52-bbfe-493f-b1e2-657bfa027aa4 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:30.381509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-f5ba4399-3265-4ba4-bd6f-170978a2385a req-7339be52-bbfe-493f-b1e2-657bfa027aa4 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:30.393842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-f5ba4399-3265-4ba4-bd6f-170978a2385a req-7339be52-bbfe-493f-b1e2-657bfa027aa4 service nova] Creating event network-vif-plugged:88c8bb0a-387a-48a4-8c7e-f64217bd737b for instance 163b46c6-bff4-4247-afc3-06617093f4de on hv-cinder-84884 Jul 06 15:33:30.399083 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-f5ba4399-3265-4ba4-bd6f-170978a2385a req-7339be52-bbfe-493f-b1e2-657bfa027aa4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033368 Jul 06 15:33:30.400025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 481/1006] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:33:30.501126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:30.509155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:30.511195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:30.512357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-25013621-0a95-4298-b97f-778416c1ec7f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.176315 Jul 06 15:33:30.513105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 526/1007] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:30 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:31.531028 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:31.531745 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:31.537902 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:31.538344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:31.539100 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:31.539564 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:31.557493 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:31.669957 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:31.677763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:31.679363 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:31.680467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fc6e6538-2d41-401f-b180-58955459f30b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1407 microversion: 2.20 time: 0.154322 Jul 06 15:33:31.681026 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 482/1008] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:31 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:32.698309 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:32.698911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:32.701178 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:32.701827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=10 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:32.707760 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:32.708205 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:32.708955 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:32.709385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:32.836199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:32.844252 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:32.845753 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:32.846891 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f3d1aa85-0ffa-4def-bf5c-f625aecf3a0d tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1599 microversion: 2.20 time: 0.153013 Jul 06 15:33:32.847477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 527/1009] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:33:32 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:33:32.863842 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:32.864336 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:32.866102 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:32.872408 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:32.872854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:32.873609 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:32.874042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:32.950146 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f42986b6-72c6-48a0-a6e7-e8341cb71e13 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090174 Jul 06 15:33:32.950744 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 483/1010] 10.222.0.46 () {60 vars in 1315 bytes} [Wed Jul 6 15:33:32 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:33:34.133592 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-5031bff4-92d7-4e19-aeec-bfe87cbc28c3 req-8a691c1a-1c19-4c93-aaff-882583acecc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:34.142497 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-5031bff4-92d7-4e19-aeec-bfe87cbc28c3 req-8a691c1a-1c19-4c93-aaff-882583acecc0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:34.142932 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-5031bff4-92d7-4e19-aeec-bfe87cbc28c3 req-8a691c1a-1c19-4c93-aaff-882583acecc0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:34.154490 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-5031bff4-92d7-4e19-aeec-bfe87cbc28c3 req-8a691c1a-1c19-4c93-aaff-882583acecc0 service nova] Creating event network-changed:88c8bb0a-387a-48a4-8c7e-f64217bd737b for instance 163b46c6-bff4-4247-afc3-06617093f4de on hv-cinder-84884 Jul 06 15:33:34.159500 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-5031bff4-92d7-4e19-aeec-bfe87cbc28c3 req-8a691c1a-1c19-4c93-aaff-882583acecc0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029623 Jul 06 15:33:34.160515 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 528/1011] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:56.173491 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:56.174945 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=6 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:56.176496 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:56.177243 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:56.180614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:56.181272 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:56.181680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-3869012f-4b90-423b-97a2-ef019f3b4679 req-2a7c1583-d1b3-4607-a701-680623fd99f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:56.189004 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:56.189875 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:56.190867 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:56.191487 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:56.192054 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3869012f-4b90-423b-97a2-ef019f3b4679 req-2a7c1583-d1b3-4607-a701-680623fd99f1 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:56.192712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3869012f-4b90-423b-97a2-ef019f3b4679 req-2a7c1583-d1b3-4607-a701-680623fd99f1 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:56.205960 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-3869012f-4b90-423b-97a2-ef019f3b4679 req-2a7c1583-d1b3-4607-a701-680623fd99f1 service nova] Creating event network-changed:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:33:56.211418 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-3869012f-4b90-423b-97a2-ef019f3b4679 req-2a7c1583-d1b3-4607-a701-680623fd99f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036376 Jul 06 15:33:56.212819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 529/1012] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:33:56.220013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Going to try to terminate instance {{(pid=117620) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:33:56.304570 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4b35109e-f504-40f7-86ab-ddff5cb47886 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "DELETE /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 204 len: 0 microversion: 2.1 time: 0.132000 Jul 06 15:33:56.309168 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 484/1013] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:33:56 2022] DELETE /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:33:56.316007 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:56.319577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:56.330236 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:56.330925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:56.331739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:56.332574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:56.471637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:56.479199 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b173a468-4b87-4010-8e48-1ae380a150bf tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.168729 Jul 06 15:33:56.479795 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 530/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:56 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:57.498171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:57.498858 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:57.505332 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:57.505717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:57.506469 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:57.506893 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:57.654446 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:57.662270 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-bcf37d2e-9b03-4f6e-8958-9276b92959ad tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1569 microversion: 2.1 time: 0.168949 Jul 06 15:33:57.662866 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 485/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:57 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:58.443712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-2a515f1a-3f06-4536-8d8e-962818e1421f req-5f21cd88-425a-4d53-a078-dd7f9d72bdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825", "name": "network-vif-deleted", "tag": "1d111c7f-26a5-4b88-b2d7-d536d2ce685b"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:33:58.453024 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-2a515f1a-3f06-4536-8d8e-962818e1421f req-5f21cd88-425a-4d53-a078-dd7f9d72bdf2 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:58.453464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-2a515f1a-3f06-4536-8d8e-962818e1421f req-5f21cd88-425a-4d53-a078-dd7f9d72bdf2 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:58.465082 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-2a515f1a-3f06-4536-8d8e-962818e1421f req-5f21cd88-425a-4d53-a078-dd7f9d72bdf2 service nova] Creating event network-vif-deleted:1d111c7f-26a5-4b88-b2d7-d536d2ce685b for instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 on hv-cinder-84884 Jul 06 15:33:58.469943 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-2a515f1a-3f06-4536-8d8e-962818e1421f req-5f21cd88-425a-4d53-a078-dd7f9d72bdf2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029924 Jul 06 15:33:58.470545 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 531/1016] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:33:58.679939 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:58.680482 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:58.687572 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:58.688011 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:58.688776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:58.689185 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:58.759761 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ae63f0fa9e4c9ab82d46d6d24d22e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42279c5b622c47a192c529ce53566555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:33:58.768293 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0d52725d-a7fd-4904-bacf-1148c6466991 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 200 len: 1219 microversion: 2.1 time: 0.092233 Jul 06 15:33:58.768880 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 486/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:58 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:33:59.786636 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:59.787359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] [instance: 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:33:59.793501 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:59.793950 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:59.794708 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:33:59.795143 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:33:59.808430 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] HTTP exception thrown: Instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 could not be found. Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Request method failure captured: Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 HTTP/1.1 Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixapB7hpdAxyGyYKR-DSwm9bF4oaJIp6PwdwX82SMkYgF35qRu-tk8Ep6ij7MsPe3yTgbBbgPMZOSr-LSb00cHiB8MKqJQYbKa3hsA5jDrG5w-0mfs5yFdnG8ujYXVKHJ1fUGgJitaNbx_Zrzs_pYKB-nXoAzck8UqX92RjzJ79cMOGw Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 42279c5b622c47a192c529ce53566555 Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestShelveInstance-1253940444 Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:33:59.810012 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42279c5b622c47a192c529ce53566555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42279c5b622c47a192c529ce53566555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42279c5b622c47a192c529ce53566555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42279c5b622c47a192c529ce53566555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestShelveInstance-1253940444 Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 42279c5b622c47a192c529ce53566555 Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestShelveInstance-1253940444 Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-TestShelveInstance-1253940444-project Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: f8ae63f0fa9e4c9ab82d46d6d24d22e3 Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestShelveInstance-1253940444-project Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 could not be found. Jul 06 15:33:59.811821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825'} Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 could not be found. Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:33:59.812830 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 could not be found. Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 could not be found. Jul 06 15:33:59.814485 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:33:59.815951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Returning 404 to user: Instance 95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:33:59.815951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-38c2be70-dbb5-404f-aa8e-fe02fee58c03 tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825" status: 404 len: 111 microversion: 2.1 time: 0.029455 Jul 06 15:33:59.815951 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 532/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:33:59 2022] GET /compute/v2.1/servers/95b8e92c-2b10-4bd8-a4fa-ed8f75b1c825 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:33:59.966335 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8f1290e7-e410-44d0-802d-737b25df8cab tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] Calling method '.version_select at 0x7f449c5d74c0>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:33:59.984361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8f1290e7-e410-44d0-802d-737b25df8cab tempest-TestShelveInstance-1253940444 tempest-TestShelveInstance-1253940444-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1050729177" status: 202 len: 0 microversion: 2.1 time: 0.021768 Jul 06 15:33:59.984947 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 487/1019] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Jul 6 15:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1050729177 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:34:10.201815 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:10.202359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:10.204351 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=8 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:10.204972 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:10.210714 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:10.211154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:10.211931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:10.212359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:10.234976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8a786af0-5d7d-4534-a191-7fe389e58301 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/ips" status: 200 len: 152 microversion: 2.20 time: 0.037244 Jul 06 15:34:10.235561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 533/1020] 10.222.0.46 () {60 vars in 1288 bytes} [Wed Jul 6 15:34:10 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 06 15:34:12.037539 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:12.038295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:12.042668 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:34:12.043201 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:12.052534 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:12.052979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:12.053740 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:12.054177 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:12.079114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.objects.instance [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lazy-loading 'flavor' on Instance uuid 163b46c6-bff4-4247-afc3-06617093f4de {{(pid=117620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:34:12.329853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f80c2cb5-85e2-40bd-a0b5-7cede04eab5a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/action" status: 202 len: 0 microversion: 2.20 time: 0.293495 Jul 06 15:34:12.330476 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 488/1021] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jul 6 15:34:12 2022] POST /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:34:12.338689 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:12.339336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:12.345711 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:12.346153 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:12.346974 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:12.347408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:12.476826 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:12.486326 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:12.487889 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:12.489050 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fd3ea61f-9e8d-4ac7-96e9-9fbf5a35579f tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.154473 Jul 06 15:34:12.489618 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 534/1022] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:12 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:13.509143 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:13.509758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:13.515963 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:13.516406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:13.517152 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:13.517581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:13.654092 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:13.661904 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:13.663556 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:13.664708 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-754ec4c4-1fa0-428f-8fc1-331e49723b20 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.160421 Jul 06 15:34:13.665265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 489/1023] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:13 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:14.683920 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:14.684527 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:14.690925 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:14.691409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:14.692164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:14.692598 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:14.820352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:14.828115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:14.829680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:14.830831 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ff3d977a-000a-4fc8-8898-c33656651f45 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.151530 Jul 06 15:34:14.831409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 535/1024] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:14 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:15.849343 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:15.849945 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:15.857110 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:15.857554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:15.858299 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:15.858730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:15.983399 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:15.991274 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:15.992795 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:15.993942 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-4b6b5685-ee9f-4da4-a0bd-59448dd1fce9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.148516 Jul 06 15:34:15.994503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 490/1025] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:15 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:17.012011 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:17.012616 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:17.019002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:17.019478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:17.020474 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:17.020908 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:17.147375 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:17.155670 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:17.157173 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:17.158316 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-45922156-aa00-4dfb-a4d6-b33147107029 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.150228 Jul 06 15:34:17.158875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 536/1026] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:17 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:18.177067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:18.177779 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:18.184925 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:18.185379 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:18.186144 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:18.186576 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:18.317538 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:18.325730 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:18.327304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:18.328461 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e1d2b281-6ab2-444c-9921-61224938ac9b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.155420 Jul 06 15:34:18.329025 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 491/1027] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:18 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:19.345776 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:19.346405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:19.352842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:19.353903 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:19.354734 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:19.355163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:19.485905 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:19.493693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:19.495191 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:19.496355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b7657e9e-55c6-44b2-8f0f-26f0a604a7b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.154465 Jul 06 15:34:19.496917 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 537/1028] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:19 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:20.514197 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:20.514746 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:20.521339 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:20.521778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:20.522547 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:20.522977 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:20.655210 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:20.662975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:20.664502 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:20.666134 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7d1b7dde-9525-4db8-a12a-99149dad7b5b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.155464 Jul 06 15:34:20.666684 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 492/1029] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:20 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:21.684168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:21.684770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:21.691408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:21.691850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:21.692593 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:21.693022 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:21.816827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:21.825235 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:21.826749 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:21.827910 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6573d875-2fa1-4370-a072-ad36fe1e2c6c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.148164 Jul 06 15:34:21.828465 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 538/1030] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:21 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:22.845714 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:22.846322 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:22.853412 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:22.853860 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:22.854620 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:22.855056 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:22.984507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:22.992419 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:22.993924 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:22.995081 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-39ec6704-aa87-4b96-81e9-9b8f2669778a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.153290 Jul 06 15:34:22.995671 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 493/1031] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:22 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:24.013657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:24.014295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:24.020961 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:24.021409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:24.022164 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:24.022597 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:24.146058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:24.153931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:24.155482 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:24.156625 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-712d6ae4-b729-4b77-b37e-58efa291f5b8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.147589 Jul 06 15:34:24.157183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 539/1032] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:24 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:25.174978 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:25.175615 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:25.182118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:25.182560 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:25.183348 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:25.183772 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:25.310567 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:25.318373 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:25.319892 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:25.321034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a5dd0f11-efff-47b5-9061-022d576fc156 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.149969 Jul 06 15:34:25.322185 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 494/1033] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:25 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:26.340105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:26.340719 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:26.347204 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:26.347683 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:26.348447 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:26.348878 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:26.477336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:26.485083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:26.486590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:26.487768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8b4487e3-bc01-4e39-8a44-1d666f81a23c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.152458 Jul 06 15:34:26.488322 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 540/1034] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:26 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:27.505853 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:27.506410 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:27.512876 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:27.513318 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:27.514065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:27.514490 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:27.643371 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:27.651884 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:27.653378 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:27.654519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-873ee109-dd4a-4548-8f29-07b07e98a805 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.152645 Jul 06 15:34:27.655082 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 495/1035] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:27 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:28.672376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:28.672985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:28.679396 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:28.679841 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:28.680605 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:28.681633 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:28.809355 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:28.817303 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:28.818875 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:28.820096 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1e21ea9c-22f3-49e8-b49f-e0c6eccf82f3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1745 microversion: 2.20 time: 0.151593 Jul 06 15:34:28.820661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 541/1036] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:28 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:29.838607 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:29.839242 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:29.845964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:29.846411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:29.847171 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:29.848151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:29.977237 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:29.985618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:29.987121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:29.988311 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-cbb98fe6-879d-46ab-8a42-e009ff44bad9 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1745 microversion: 2.20 time: 0.153656 Jul 06 15:34:29.988866 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 496/1037] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:29 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:30.772120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-236d9ffd-da7a-4156-be13-80bc9d3097ca req-477fbc7e-e30e-45bc-8fd2-eacc4c745d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "name": "network-vif-plugged", "status": "completed", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:34:30.781405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-236d9ffd-da7a-4156-be13-80bc9d3097ca req-477fbc7e-e30e-45bc-8fd2-eacc4c745d3a service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:30.781843 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-236d9ffd-da7a-4156-be13-80bc9d3097ca req-477fbc7e-e30e-45bc-8fd2-eacc4c745d3a service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:30.795267 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-236d9ffd-da7a-4156-be13-80bc9d3097ca req-477fbc7e-e30e-45bc-8fd2-eacc4c745d3a service nova] Creating event network-vif-plugged:88c8bb0a-387a-48a4-8c7e-f64217bd737b for instance 163b46c6-bff4-4247-afc3-06617093f4de on hv-cinder-84884 Jul 06 15:34:30.801157 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-236d9ffd-da7a-4156-be13-80bc9d3097ca req-477fbc7e-e30e-45bc-8fd2-eacc4c745d3a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Jul 06 15:34:30.802276 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 542/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:34:31.006150 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:31.006788 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:31.014042 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:31.014498 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:31.015289 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:31.015911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:31.164032 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:31.172495 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:31.174156 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:31.175197 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-9446ad69-bcc7-4c01-90b8-e01173d12ef3 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.173010 Jul 06 15:34:31.175782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 497/1039] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:31 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:32.194469 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:32.195911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:32.205822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:32.206275 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:32.207047 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:32.207502 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:32.352386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:32.361637 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:32.363436 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:32.364594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df0964d4-143d-493c-ae17-85bc709c52b7 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.174543 Jul 06 15:34:32.365479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 543/1040] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:32 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:33.384063 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:33.384782 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:33.395690 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:33.396367 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:33.397145 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:33.397776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:33.558713 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:33.566776 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:33.568355 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:33.569501 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0b924f8d-2056-40b2-a42a-e6fbec2eb833 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.189794 Jul 06 15:34:33.570247 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 498/1041] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:33 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:34.588819 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:34.589349 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:34.596183 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:34.596635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:34.597406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:34.597844 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:34.762883 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:34.772817 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:34.776020 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:34.778574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a839bdf4-10db-4444-8851-a01243a67007 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.194293 Jul 06 15:34:34.779799 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 544/1042] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:34 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:35.797467 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:35.798248 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:35.810261 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:35.810819 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:35.811697 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:35.812205 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:35.959563 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:35.968426 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:35.970091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:35.971366 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e9740a77-2c1d-45b7-b206-2c295b4ac7d1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.177884 Jul 06 15:34:35.972108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 499/1043] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:35 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:36.989904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:36.990602 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:36.997042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:36.997431 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:36.998180 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:36.998607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:37.352743 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:37.362031 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:37.364676 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:37.365857 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e28266e9-4e2b-46ac-ba83-678b55ae6043 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.379816 Jul 06 15:34:37.366430 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 545/1044] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:36 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:38.384621 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:38.385172 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:38.391503 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:38.391959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:38.392739 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:38.393165 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:38.596581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:38.604863 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:38.606383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:38.607619 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-885a6e20-cc9a-4901-a305-7741208a633c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1740 microversion: 2.20 time: 0.227053 Jul 06 15:34:38.608509 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 500/1045] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:38 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:39.625900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:39.626511 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:39.633001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:39.633450 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:39.634784 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:39.635233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:39.763427 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:39.771661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:39.773201 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:39.775051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-020a5378-3546-4ab9-8837-df92e0a177ff tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1722 microversion: 2.20 time: 0.152406 Jul 06 15:34:39.775591 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 546/1046] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:39 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:40.794108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:40.794717 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:40.801155 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:40.801607 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:40.802369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:40.802804 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:40.931709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:40.939513 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:40.941009 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:40.942166 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-45a62c65-2928-4ac8-b07b-1b2efa184b14 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1722 microversion: 2.20 time: 0.152525 Jul 06 15:34:40.942710 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 501/1047] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:40 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:41.960161 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:41.960747 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:41.963612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=29 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:41.969223 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:41.969665 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:41.970416 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:41.970841 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:41.973585 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=79 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:42.097570 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:42.106049 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:42.107584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:42.108738 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0eacbaaa-a039-4710-838e-8f6455b1d9be tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1665 microversion: 2.20 time: 0.152483 Jul 06 15:34:42.109294 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 547/1048] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:41 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:42.128377 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a79e53a-43f0-48f6-a595-7e5d35f41295"}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:34:42.129482 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:42.131879 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=29 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:42.137995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.138449 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.139230 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.139681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.143450 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:42.398438 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e30f5f53-07a3-44dd-8532-71f44dfbd1e8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.274056 Jul 06 15:34:42.399067 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 502/1049] 10.222.0.46 () {62 vars in 1363 bytes} [Wed Jul 6 15:34:42 2022] POST /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 06 15:34:42.510846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:42.511379 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:42.517450 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.517902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.518664 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.519383 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.755128 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-01f815a9-a5db-42a5-aab8-f502eb2b5834 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-volume_attachments/1a79e53a-43f0-48f6-a595-7e5d35f41295" status: 202 len: 0 microversion: 2.20 time: 0.248837 Jul 06 15:34:42.755768 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 548/1050] 10.222.0.46 () {60 vars in 1456 bytes} [Wed Jul 6 15:34:42 2022] DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-volume_attachments/1a79e53a-43f0-48f6-a595-7e5d35f41295 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:34:42.774934 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-26baef35-fbd6-42e7-808b-e0e464b2e1b8 req-15fe46ba-1c90-40b4-8bbe-fccca37f6abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "name": "network-vif-unplugged", "status": "completed", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:34:42.783743 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-26baef35-fbd6-42e7-808b-e0e464b2e1b8 req-15fe46ba-1c90-40b4-8bbe-fccca37f6abe service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.784216 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-26baef35-fbd6-42e7-808b-e0e464b2e1b8 req-15fe46ba-1c90-40b4-8bbe-fccca37f6abe service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.795683 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.compute.server_external_events [req-26baef35-fbd6-42e7-808b-e0e464b2e1b8 req-15fe46ba-1c90-40b4-8bbe-fccca37f6abe service nova] Unable to find a host for instance 163b46c6-bff4-4247-afc3-06617093f4de. Dropping event network-vif-unplugged {{(pid=117620) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 06 15:34:42.796574 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-26baef35-fbd6-42e7-808b-e0e464b2e1b8 req-15fe46ba-1c90-40b4-8bbe-fccca37f6abe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025476 Jul 06 15:34:42.797471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 503/1051] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 06 15:34:42.820681 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:34:42.821893 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:42.828468 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.828924 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.829688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.830125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.903163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-91e3344a-a482-482b-a87c-ccaeca1311cc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "POST /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/action" status: 202 len: 0 microversion: 2.20 time: 0.086372 Jul 06 15:34:42.903800 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 549/1052] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jul 6 15:34:42 2022] POST /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:34:42.911767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:42.912374 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:42.918839 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.919325 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:42.920079 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:42.920512 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:43.081999 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:43.090688 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:43.092243 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:43.093411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3b128e81-936d-4e67-a1a1-e3138b2ed4c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1673 microversion: 2.20 time: 0.185489 Jul 06 15:34:43.093975 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 504/1053] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:42 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:44.112120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:44.112763 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:44.119242 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:44.119718 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:44.120479 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:44.120911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:44.251840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:44.261032 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:44.262556 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:44.263771 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-20c0d9d7-7049-4809-8ca4-8a7fe4b2aa5c tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.156106 Jul 06 15:34:44.264336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 550/1054] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:44 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:45.283965 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:45.284573 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:45.290985 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:45.291556 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:45.292431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:45.292880 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:45.429151 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:45.438522 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:45.440079 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:45.441253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ac3a24f1-0ef9-42d1-bb88-8ceebcf57645 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.161521 Jul 06 15:34:45.441812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 505/1055] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:45 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:46.460356 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:46.460973 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:46.468089 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:46.468693 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:46.469523 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:46.469954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:46.602578 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:46.610931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:46.612660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:46.614117 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-94237cbe-d850-4aaf-9b3f-d1c3a3a71b8b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.157870 Jul 06 15:34:46.614756 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 551/1056] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:46 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:47.632406 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:47.632932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:47.639832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:47.640284 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:47.641056 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:47.641492 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:47.784974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:47.793903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:47.795459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:47.796826 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-574cfc78-3b78-4519-97c3-e24e08d22aba tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.168389 Jul 06 15:34:47.797583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 506/1057] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:47 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:48.816363 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:48.816948 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:48.824661 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:48.825168 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:48.825947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:48.826385 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:48.962765 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:48.971058 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:48.972715 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:48.973976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a11ce8a6-9d19-4f3c-bd6b-30ab3d9ec842 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.161583 Jul 06 15:34:48.974662 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 552/1058] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:48 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 06 15:34:49.993114 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:49.993737 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:50.000232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:50.000682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:50.001451 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:50.001887 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:50.141145 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:50.149795 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:50.151344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:50.152523 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f3cfbc36-54b6-40ce-b9ba-0c0e048f85b0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.163831 Jul 06 15:34:50.153095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 507/1059] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:49 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:51.170731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:51.171483 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:51.178433 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:51.179120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:51.180777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:51.181241 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:51.328069 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:51.336704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:51.338434 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:51.339797 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0d04ddfc-aa40-41ad-a711-44681afc4e40 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.173287 Jul 06 15:34:51.341491 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 553/1060] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:51 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:52.359357 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:52.359991 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:52.366631 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:52.367081 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:52.368387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:52.368822 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:52.527435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:52.535239 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:52.536763 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:52.538051 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-fc2cfc70-bed7-488f-9316-13a30bd2c84a tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.182723 Jul 06 15:34:52.538801 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 508/1061] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:52 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:53.555921 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:53.556520 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:53.563124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:53.563607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:53.564378 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:53.564813 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:53.696770 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:53.704612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:53.706126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:53.707289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2faec7ec-1db8-45c9-bce0-13b809c40a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.155299 Jul 06 15:34:53.707850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 554/1062] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:53 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:54.724903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:54.725537 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:54.732555 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:54.732996 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:54.733759 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:54.734192 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:54.875632 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:54.884774 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:54.886295 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:54.887507 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-eb716abb-8fa1-42dd-97cb-4b6f909783dd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.166521 Jul 06 15:34:54.888070 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 509/1063] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:54 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:55.905464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:55.906062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:55.912472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:55.912898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:55.913641 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:55.914067 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:56.039029 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:56.046798 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:56.048340 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:56.049478 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ce539f69-2bf7-4066-b14b-8858172058b1 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.147962 Jul 06 15:34:56.050034 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 555/1064] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:55 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:56.844832 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-76119b33-6278-48a3-b04b-e9bccb2e3005 req-4b75db65-233b-4213-8e0e-c65a06f474fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "name": "network-vif-plugged", "status": "completed", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:34:56.854313 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-76119b33-6278-48a3-b04b-e9bccb2e3005 req-4b75db65-233b-4213-8e0e-c65a06f474fc service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:56.854770 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-76119b33-6278-48a3-b04b-e9bccb2e3005 req-4b75db65-233b-4213-8e0e-c65a06f474fc service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:56.866118 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-76119b33-6278-48a3-b04b-e9bccb2e3005 req-4b75db65-233b-4213-8e0e-c65a06f474fc service nova] Creating event network-vif-plugged:88c8bb0a-387a-48a4-8c7e-f64217bd737b for instance 163b46c6-bff4-4247-afc3-06617093f4de on hv-cinder-84884 Jul 06 15:34:56.871291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-76119b33-6278-48a3-b04b-e9bccb2e3005 req-4b75db65-233b-4213-8e0e-c65a06f474fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030483 Jul 06 15:34:56.871963 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 510/1065] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:34:57.067802 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:57.068406 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:57.074788 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:57.075238 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:57.076018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:57.076449 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:57.207631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:57.216098 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:57.217586 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:57.218718 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-15a47aa5-bd13-4c44-96da-10b3fb955073 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.154906 Jul 06 15:34:57.219350 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 556/1066] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:57 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:58.237433 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:58.238471 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:58.244580 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:58.245023 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:58.245891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:58.246268 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:58.382131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:58.390712 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:58.392344 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:58.393829 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f73e2ff3-ae70-4c1f-8c09-1efd5f1e1ecc tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1731 microversion: 2.20 time: 0.160836 Jul 06 15:34:58.394405 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 511/1067] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:58 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:34:59.412387 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:34:59.412985 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:34:59.419842 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:59.420285 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:59.421025 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:34:59.421449 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:34:59.545357 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:59.553202 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:59.554721 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:34:59.556541 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7fb17cbe-617a-48ab-b5b9-b24777d0aa86 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1718 microversion: 2.20 time: 0.148085 Jul 06 15:34:59.557097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 557/1068] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:34:59 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:35:21.238960 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:21.240253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:21.243682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=19 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:21.244322 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:21.249803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:21.250276 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:21.251048 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:21.251505 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:21.277234 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Going to try to terminate instance {{(pid=117620) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:35:21.353302 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-2c26ce5b-3837-4850-bf60-7737cd7cb13d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 204 len: 0 microversion: 2.1 time: 0.117954 Jul 06 15:35:21.353614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 512/1069] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:35:21 2022] DELETE /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:35:21.362461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:21.363076 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:21.365304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=23 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:21.365993 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:21.372158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:21.372612 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:21.373380 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:21.373822 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:21.504555 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:21.511992 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e0ac6173-c225-411f-8f10-bb598a3cf27b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1576 microversion: 2.1 time: 0.153511 Jul 06 15:35:21.512559 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 558/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:21 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:22.529903 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:22.530526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:22.536869 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:22.537346 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:22.538098 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:22.538528 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:22.673084 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:22.680529 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-50f885b0-960e-4c91-8298-1673eb145b31 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1576 microversion: 2.1 time: 0.155011 Jul 06 15:35:22.681097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 513/1071] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:22 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:23.699106 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:23.700456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:23.707492 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:23.708010 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:23.709083 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:23.709526 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:23.774420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:23.781947 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b4ba726d-0689-45db-bb69-ac757fc3222a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 200 len: 1508 microversion: 2.1 time: 0.087087 Jul 06 15:35:23.782518 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 559/1072] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:23 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 1508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:24.033179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-49abcbf9-7c9f-4e20-afeb-88fa9ed6f868 req-8ae1ad64-d47c-4ac7-a80c-cacd8db16400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c304cb7c-8615-4f10-836c-78b4ae231d57", "name": "network-vif-deleted", "tag": "b0ef2a66-9d47-4a02-a75e-4a955b7b7809"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:35:24.044131 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-49abcbf9-7c9f-4e20-afeb-88fa9ed6f868 req-8ae1ad64-d47c-4ac7-a80c-cacd8db16400 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:24.044579 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-49abcbf9-7c9f-4e20-afeb-88fa9ed6f868 req-8ae1ad64-d47c-4ac7-a80c-cacd8db16400 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:24.056382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-49abcbf9-7c9f-4e20-afeb-88fa9ed6f868 req-8ae1ad64-d47c-4ac7-a80c-cacd8db16400 service nova] Creating event network-vif-deleted:b0ef2a66-9d47-4a02-a75e-4a955b7b7809 for instance c304cb7c-8615-4f10-836c-78b4ae231d57 on hv-cinder-84884 Jul 06 15:35:24.062216 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-49abcbf9-7c9f-4e20-afeb-88fa9ed6f868 req-8ae1ad64-d47c-4ac7-a80c-cacd8db16400 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103582 Jul 06 15:35:24.063127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 514/1073] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:35:24.798536 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:24.799151 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:24.806193 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:24.806657 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:24.807470 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:24.807931 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:24.822744 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] HTTP exception thrown: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Request method failure captured: Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 HTTP/1.1 Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixasdl6aiVY6nTw08_3y6r8UhUX8Lj0LGDYzbcRYd7q5s9pP9EooV3g2AvL3Ovljb0rHP2ke_OEZeK-aH2QxvnatfVK6qWn_3sF-UAFwPnr4KRxbhve1nif8UW4qNM9MQyys246XQkGIUuTWFUne6yBb2A8Td68uyRL8rv9fuo-5z6t4 Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:35:24.824266 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 7f9e0665a37d490f8b62205c5890da56 Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:35:24.825939 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'c304cb7c-8615-4f10-836c-78b4ae231d57'} Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:35:24.826808 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:35:24.828227 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:24.829461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Returning 404 to user: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:35:24.829461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4c952867-6bab-4c69-a07e-52a8e93dd0a6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 404 len: 111 microversion: 2.1 time: 0.031166 Jul 06 15:35:24.832904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 560/1074] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:24 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:35:24.927682 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1608266739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1567947179", "security_groups": [{"name": "tempest-secgroup-smoke-2098609478"}], "block_device_mapping_v2": [{"uuid": "71c3d348-9c74-4f5d-8581-d3dc66afa9b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "784d35cc-1e96-42d9-b35a-63f5c285a35a"}]}} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:35:25.042466 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.network.neutron [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] validate_networks() for [('784d35cc-1e96-42d9-b35a-63f5c285a35a', None, None, None, None, None)] {{(pid=117620) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:35:25.420308 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Flavor limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:35:25.420729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Image limits 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:35:25.421200 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Flavor pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:35:25.421606 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Image pref 0:0:0 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:35:25.422010 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.virt.hardware [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:35:25.430960 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:25.431435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:25.432233 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:25.432659 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:25.449802 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:35:25.453671 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.quota [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for user 7f9e0665a37d490f8b62205c5890da56 and project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'cores', 'instances', 'ram'} {{(pid=117620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:35:25.508915 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Going to run 1 instances... {{(pid=117620) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:35:25.511089 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71c3d348-9c74-4f5d-8581-d3dc66afa9b7',volume_size=None,volume_type=None)] {{(pid=117620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:35:25.633227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6e09a0a4-426f-4503-920a-e12cc70ea550 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709757 Jul 06 15:35:25.633873 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 515/1075] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:35:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:35:25.644169 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-27507f17-d399-4e42-a6b4-93cc7a194302 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:25.644782 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-27507f17-d399-4e42-a6b4-93cc7a194302 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:25.908739 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-27507f17-d399-4e42-a6b4-93cc7a194302 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:25.916142 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-27507f17-d399-4e42-a6b4-93cc7a194302 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1095 microversion: 2.1 time: 0.276120 Jul 06 15:35:25.916909 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 561/1076] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:25 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1095 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:26.936020 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:26.936644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:26.944823 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:26.945480 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:26.946255 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:26.946694 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:27.021700 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:27.029644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b07cbd82-26bf-4b33-848d-cedb53f1c9a0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1211 microversion: 2.1 time: 0.099732 Jul 06 15:35:27.030211 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 516/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:26 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:27.937456 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-cbef784d-7b95-4e6e-b92c-d3c9cdbf9fe2 req-92a8c1ab-8b7d-4621-a102-2615f391b8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723f31b1-47e5-4825-ad25-22d7b21913b1", "tag": "101ed713-aa30-491f-b239-e9d0f48d90ee"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:35:27.965396 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-cbef784d-7b95-4e6e-b92c-d3c9cdbf9fe2 req-92a8c1ab-8b7d-4621-a102-2615f391b8ec service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:27.965851 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-cbef784d-7b95-4e6e-b92c-d3c9cdbf9fe2 req-92a8c1ab-8b7d-4621-a102-2615f391b8ec service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:27.980042 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-cbef784d-7b95-4e6e-b92c-d3c9cdbf9fe2 req-92a8c1ab-8b7d-4621-a102-2615f391b8ec service nova] Creating event network-changed:101ed713-aa30-491f-b239-e9d0f48d90ee for instance 723f31b1-47e5-4825-ad25-22d7b21913b1 on hv-cinder-84884 Jul 06 15:35:27.986736 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-cbef784d-7b95-4e6e-b92c-d3c9cdbf9fe2 req-92a8c1ab-8b7d-4621-a102-2615f391b8ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061577 Jul 06 15:35:27.987522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 562/1078] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:35:28.045974 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:28.046772 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:28.053546 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:28.053993 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:28.054758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:28.055188 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:28.265900 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:28.273732 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-30f8ac59-61e7-4451-ad82-ae0b00899cbd tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.231662 Jul 06 15:35:28.274383 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 517/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:28 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:29.290512 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:29.291226 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:29.297888 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:29.298332 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:29.299077 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:29.299533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:29.427991 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:29.435249 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-403c35ac-cdd3-43d9-94b4-4591554f1ffc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.148935 Jul 06 15:35:29.435809 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 563/1080] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:29 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:30.451751 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:30.452349 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:30.458729 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:30.459175 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:30.459954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:30.460382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:30.589065 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:30.596845 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-b5ba01f9-404b-4091-a49c-88d7df61b0cc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.148976 Jul 06 15:35:30.597415 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 518/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:30 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:31.613538 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:31.614118 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:31.620694 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:31.621145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:31.621904 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:31.622964 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:31.752293 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:31.759716 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3363e9a9-d71c-4ea7-b2c5-f41d593d9a07 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.150097 Jul 06 15:35:31.760295 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 564/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:31 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:32.440037 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:32.441150 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:32.447526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.448060 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.448815 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.449243 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.477685 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-23b59f24-2f7f-4f15-a9c1-c83c6ac0e82b tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041612 Jul 06 15:35:32.478222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 519/1083] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jul 6 15:35:32 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:32.536208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:32.536704 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:32.542554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.542998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.543786 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.544219 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.568668 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:35:32.645141 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7e4fb371-0898-4ef7-8beb-c885762667f0 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 204 len: 0 microversion: 2.20 time: 0.112206 Jul 06 15:35:32.649631 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 565/1084] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jul 6 15:35:32 2022] DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 06 15:35:32.656058 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:32.656660 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:32.662498 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.662937 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.663716 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.664143 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.777506 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:32.778115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:32.784145 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.784586 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.785529 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:32.785969 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:32.795676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:32.803583 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:32.805097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:32.806253 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-43dacef1-25c0-4769-ba4f-ed440724a265 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.154345 Jul 06 15:35:32.806808 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 520/1085] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:35:32 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:35:32.920918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:32.928286 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-13a51b14-daac-4f6d-b32c-1dbdeb398106 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.155053 Jul 06 15:35:32.928854 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 566/1086] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:32 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:35:33.824725 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:33.825844 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:33.832325 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:33.832767 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:33.833519 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:33.833950 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:33.945224 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:33.945954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:33.952914 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:33.953367 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:33.954154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:33.954576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:33.961644 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:33.970179 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:33.971723 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:33.972878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f5c1e874-4d26-4f76-a8f5-f82f98833bdf tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1724 microversion: 2.20 time: 0.152115 Jul 06 15:35:33.973429 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 521/1087] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:35:33 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:35:34.087148 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:34.095318 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9ad7caab-34c2-4278-a06f-e0f16a3fb5f8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.153935 Jul 06 15:35:34.095900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 567/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:33 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:35:34.990411 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:34.991193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:34.998511 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:34.998958 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:34.999771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:35.000189 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:35.096369 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:35.109154 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:35.111727 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f35de73cde9436c952e0d5f95e74b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848d6c1f478d4dba813663c4c866d8b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:35.112793 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:35.113264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-a676bd52-36b6-4746-b720-68fb360eb16e tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 200 len: 1656 microversion: 2.20 time: 0.126619 Jul 06 15:35:35.113405 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:35.114673 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 522/1089] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:35:34 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 1656 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 06 15:35:35.131072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:35.131849 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:35.133147 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:35.133773 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:35.310115 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:35.319801 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-118d7734-f105-4543-95ce-d8c383c9b653 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.210699 Jul 06 15:35:35.320976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 568/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:35 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:35:35.335174 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-8d2c7ca5-99d3-4ada-93fd-643580d88a21 req-e8c99071-9caa-44ce-abaf-3e623e7dc4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163b46c6-bff4-4247-afc3-06617093f4de", "name": "network-vif-deleted", "tag": "88c8bb0a-387a-48a4-8c7e-f64217bd737b"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:35:35.345091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-8d2c7ca5-99d3-4ada-93fd-643580d88a21 req-e8c99071-9caa-44ce-abaf-3e623e7dc4bc service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:35.345983 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-8d2c7ca5-99d3-4ada-93fd-643580d88a21 req-e8c99071-9caa-44ce-abaf-3e623e7dc4bc service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:35.359628 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-8d2c7ca5-99d3-4ada-93fd-643580d88a21 req-e8c99071-9caa-44ce-abaf-3e623e7dc4bc service nova] Creating event network-vif-deleted:88c8bb0a-387a-48a4-8c7e-f64217bd737b for instance 163b46c6-bff4-4247-afc3-06617093f4de on hv-cinder-84884 Jul 06 15:35:35.366183 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-8d2c7ca5-99d3-4ada-93fd-643580d88a21 req-e8c99071-9caa-44ce-abaf-3e623e7dc4bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034442 Jul 06 15:35:35.366796 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 523/1091] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:35:36.132594 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:36.133288 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:36.135326 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:36.141067 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:36.141513 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:36.142273 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:36.142959 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:36.156812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] HTTP exception thrown: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Request method failure captured: Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de HTTP/1.1 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixaqkSnHbBRpabkdaVFlj51aQJidOoRawPFaNU5UheHsvFQ3HaCqWrt3kJfrC1HTOVBC3bBs5IvDFci4pRq2buEsePLphro3ebMPefj_cJ0D_zcx_bFd-JH4STLQXuVHbdR18ujdTp6i9w3wNWW6R_bpmsel6kZ0lWzKRZ8GwyerGvKY Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:35:36.158522 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 2f35de73cde9436c952e0d5f95e74b8b Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:36.160376 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '163b46c6-bff4-4247-afc3-06617093f4de'} Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:35:36.161262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:36.162557 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:36.163820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Returning 404 to user: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:35:36.163820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c8bbc168-0713-44fd-af2f-200098b58bbd tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 404 len: 111 microversion: 2.20 time: 0.031355 Jul 06 15:35:36.163820 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 569/1092] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:35:36 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:35:36.170213 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-6fe7c1f2-47bf-4498-ae2a-55019c666890 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '.version_select at 0x7f449c1f2d30>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:36.173705 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:36.174709 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=6 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:36.191267 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-6fe7c1f2-47bf-4498-ae2a-55019c666890 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332757099" status: 204 len: 0 microversion: 2.20 time: 0.025681 Jul 06 15:35:36.192054 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 524/1093] 10.222.0.46 () {60 vars in 1258 bytes} [Wed Jul 6 15:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332757099 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 06 15:35:36.337660 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:36.338271 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:36.345531 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:36.345984 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:36.346748 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:36.347998 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:36.510155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:36.519208 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-34300a3c-dd96-4aa6-9c1a-1210757801eb tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.185281 Jul 06 15:35:36.523062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 570/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:36 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:37.086803 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-f3b48fd2-5d9a-4c29-a237-ede5e8f1f35d req-1ca98a39-34bb-4683-b40d-c157a1b9587e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723f31b1-47e5-4825-ad25-22d7b21913b1", "name": "network-vif-plugged", "status": "completed", "tag": "101ed713-aa30-491f-b239-e9d0f48d90ee"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:35:37.096977 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-f3b48fd2-5d9a-4c29-a237-ede5e8f1f35d req-1ca98a39-34bb-4683-b40d-c157a1b9587e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.097586 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-f3b48fd2-5d9a-4c29-a237-ede5e8f1f35d req-1ca98a39-34bb-4683-b40d-c157a1b9587e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:37.109752 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-f3b48fd2-5d9a-4c29-a237-ede5e8f1f35d req-1ca98a39-34bb-4683-b40d-c157a1b9587e service nova] Creating event network-vif-plugged:101ed713-aa30-491f-b239-e9d0f48d90ee for instance 723f31b1-47e5-4825-ad25-22d7b21913b1 on hv-cinder-84884 Jul 06 15:35:37.115106 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-f3b48fd2-5d9a-4c29-a237-ede5e8f1f35d req-1ca98a39-34bb-4683-b40d-c157a1b9587e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Jul 06 15:35:37.116143 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 525/1095] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:35:37.539709 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:37.540318 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:37.547336 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.547785 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:37.548548 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.548987 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:37.676125 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:37.683584 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-70f26102-ff2b-41db-98fd-7108c77352ca tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1267 microversion: 2.1 time: 0.147780 Jul 06 15:35:37.684154 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 571/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:37 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:37.952324 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:37.952901 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:37.959425 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.959869 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:37.960627 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.961052 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:37.974366 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] HTTP exception thrown: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Request method failure captured: Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de HTTP/1.1 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixaqkSnHbBRpabkdaVFlj51aQJidOoRawPFaNU5UheHsvFQ3HaCqWrt3kJfrC1HTOVBC3bBs5IvDFci4pRq2buEsePLphro3ebMPefj_cJ0D_zcx_bFd-JH4STLQXuVHbdR18ujdTp6i9w3wNWW6R_bpmsel6kZ0lWzKRZ8GwyerGvKY Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:35:37.975995 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 2f35de73cde9436c952e0d5f95e74b8b Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:37.977667 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '163b46c6-bff4-4247-afc3-06617093f4de'} Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:35:37.978651 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:37.980227 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:37.982382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Returning 404 to user: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:35:37.982382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e0f72e69-0758-432e-b331-32958ab774c8 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 404 len: 111 microversion: 2.20 time: 0.029266 Jul 06 15:35:37.982382 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 526/1097] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jul 6 15:35:37 2022] DELETE /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:35:37.986326 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:37.986930 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 163b46c6-bff4-4247-afc3-06617093f4de] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:37.992846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.993289 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:37.994035 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:37.994461 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:38.007343 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] HTTP exception thrown: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Request method failure captured: Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de HTTP/1.1 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixaqkSnHbBRpabkdaVFlj51aQJidOoRawPFaNU5UheHsvFQ3HaCqWrt3kJfrC1HTOVBC3bBs5IvDFci4pRq2buEsePLphro3ebMPefj_cJ0D_zcx_bFd-JH4STLQXuVHbdR18ujdTp6i9w3wNWW6R_bpmsel6kZ0lWzKRZ8GwyerGvKY Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:35:38.008834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 2f35de73cde9436c952e0d5f95e74b8b Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:38.010477 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '163b46c6-bff4-4247-afc3-06617093f4de'} Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:35:38.011499 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. Jul 06 15:35:38.013018 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:38.014409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Returning 404 to user: Instance 163b46c6-bff4-4247-afc3-06617093f4de could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:35:38.014409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eec8ff0b-4c47-41ad-8e6a-1c584ace7a27 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de" status: 404 len: 111 microversion: 2.20 time: 0.027795 Jul 06 15:35:38.014409 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 572/1098] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:35:37 2022] GET /compute/v2.1/servers/163b46c6-bff4-4247-afc3-06617093f4de => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:35:38.699614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:38.700897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:38.706972 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:38.707437 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:38.708189 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:38.708618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:38.841287 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:38.848778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-c5771d21-a6b2-4548-b96d-b3bc7f234472 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1455 microversion: 2.1 time: 0.152991 Jul 06 15:35:38.849337 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 527/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:38 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:38.864435 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:38.865047 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:38.871408 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:38.872426 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:38.873195 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:38.873629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:39.009000 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:35:39.016736 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2bdcfe92-2f4f-47be-b031-880136cd4e0b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1455 microversion: 2.1 time: 0.156077 Jul 06 15:35:39.017308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 573/1100] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:35:38 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:35:39.143818 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:39.144352 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:39.150749 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:39.151197 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:39.151983 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:39.152418 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:39.165551 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] HTTP exception thrown: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Request method failure captured: Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 HTTP/1.1 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixaqkSnHbBRpabkdaVFlj51aQJidOoRawPFaNU5UheHsvFQ3HaCqWrt3kJfrC1HTOVBC3bBs5IvDFci4pRq2buEsePLphro3ebMPefj_cJ0D_zcx_bFd-JH4STLQXuVHbdR18ujdTp6i9w3wNWW6R_bpmsel6kZ0lWzKRZ8GwyerGvKY Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:35:39.167097 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 2f35de73cde9436c952e0d5f95e74b8b Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.169133 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '9a1e795f-7c0a-4f58-ba33-0b43235e9af7'} Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:35:39.170055 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.171588 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.173078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Returning 404 to user: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:35:39.173078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-ef24941f-fdb4-4b51-ba57-e1604533db84 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 404 len: 111 microversion: 2.20 time: 0.028988 Jul 06 15:35:39.173078 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 528/1101] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jul 6 15:35:39 2022] DELETE /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:35:39.179404 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:35:39.180052 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] [instance: 9a1e795f-7c0a-4f58-ba33-0b43235e9af7] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:35:39.186590 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:39.187043 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:39.187834 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:39.188275 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:39.201291 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] HTTP exception thrown: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Request method failure captured: Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 HTTP/1.1 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixaqkSnHbBRpabkdaVFlj51aQJidOoRawPFaNU5UheHsvFQ3HaCqWrt3kJfrC1HTOVBC3bBs5IvDFci4pRq2buEsePLphro3ebMPefj_cJ0D_zcx_bFd-JH4STLQXuVHbdR18ujdTp6i9w3wNWW6R_bpmsel6kZ0lWzKRZ8GwyerGvKY Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:35:39.202818 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/848d6c1f478d4dba813663c4c866d8b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 848d6c1f478d4dba813663c4c866d8b8 Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1613935803 Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 2f35de73cde9436c952e0d5f95e74b8b Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1613935803-project Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.204554 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': '9a1e795f-7c0a-4f58-ba33-0b43235e9af7'} Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:35:39.209002 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. Jul 06 15:35:39.210624 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:35:39.212051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] Returning 404 to user: Instance 9a1e795f-7c0a-4f58-ba33-0b43235e9af7 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:35:39.212051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-015633c1-0ba6-4ea4-80a2-2a0399a4a789 tempest-AttachVolumeShelveTestJSON-1613935803 tempest-AttachVolumeShelveTestJSON-1613935803-project] 10.222.0.46 "GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7" status: 404 len: 111 microversion: 2.20 time: 0.028745 Jul 06 15:35:39.212051 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 574/1102] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jul 6 15:35:39 2022] GET /compute/v2.1/servers/9a1e795f-7c0a-4f58-ba33-0b43235e9af7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 06 15:35:40.915582 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-ca190155-9286-4cf7-83ee-878d6ae13a88 req-d866c105-bd9e-43bc-ba12-a315c9439c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723f31b1-47e5-4825-ad25-22d7b21913b1", "tag": "101ed713-aa30-491f-b239-e9d0f48d90ee"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:35:40.927144 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-ca190155-9286-4cf7-83ee-878d6ae13a88 req-d866c105-bd9e-43bc-ba12-a315c9439c03 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:35:40.928046 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-ca190155-9286-4cf7-83ee-878d6ae13a88 req-d866c105-bd9e-43bc-ba12-a315c9439c03 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:35:40.942778 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-ca190155-9286-4cf7-83ee-878d6ae13a88 req-d866c105-bd9e-43bc-ba12-a315c9439c03 service nova] Creating event network-changed:101ed713-aa30-491f-b239-e9d0f48d90ee for instance 723f31b1-47e5-4825-ad25-22d7b21913b1 on hv-cinder-84884 Jul 06 15:35:40.949278 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-ca190155-9286-4cf7-83ee-878d6ae13a88 req-d866c105-bd9e-43bc-ba12-a315c9439c03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037455 Jul 06 15:35:40.950693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 529/1103] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:37:19.901911 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:19.902900 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:19.906687 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1401402435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1567947179", "security_groups": [{"name": "tempest-secgroup-smoke-2098609478"}], "block_device_mapping_v2": [{"uuid": "2177a430-da93-4120-a629-b30fca581594", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "784d35cc-1e96-42d9-b35a-63f5c285a35a"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:37:20.020187 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] validate_networks() for [('784d35cc-1e96-42d9-b35a-63f5c285a35a', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 06 15:37:20.478918 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 06 15:37:20.479386 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 06 15:37:20.479859 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 06 15:37:20.480264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 06 15:37:20.480669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 06 15:37:20.489302 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:20.489744 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:20.490533 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:20.490962 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:20.508126 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 06 15:37:20.512001 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Getting quotas for user 7f9e0665a37d490f8b62205c5890da56 and project 6d724d364f9b4bafb241a0bb0b02429f. Resources: {'cores', 'instances', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 06 15:37:20.568781 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 06 15:37:20.570846 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2177a430-da93-4120-a629-b30fca581594',volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 06 15:37:20.691967 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8160000a-6dd2-46f2-8437-a046a9803032 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791930 Jul 06 15:37:20.692602 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 575/1104] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jul 6 15:37:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 06 15:37:20.701162 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:20.702021 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:20.708137 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-d87d96a4-348f-43f5-b86c-280543d36f4f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:20.708854 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-d87d96a4-348f-43f5-b86c-280543d36f4f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:20.766836 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-d87d96a4-348f-43f5-b86c-280543d36f4f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:20.774460 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-d87d96a4-348f-43f5-b86c-280543d36f4f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1095 microversion: 2.1 time: 0.075645 Jul 06 15:37:20.775022 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 530/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:20 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:21.791629 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:21.792366 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:21.798414 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:21.798855 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:21.799644 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:21.800072 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:21.863954 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:21.871415 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e1f080eb-c12d-4e87-9866-c9c562999a7a tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1211 microversion: 2.1 time: 0.084322 Jul 06 15:37:21.880983 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 576/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:21 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:22.889034 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:22.890553 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:22.897771 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:22.898635 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:22.899640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:22.900291 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:23.029291 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-d49a9eba-4915-4552-875f-ce2cef7305c3 req-25bbfb5e-c968-4512-b202-93a7929fa5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fedb21-72a2-4052-845e-01d588e3589f", "tag": "be58011f-fd4e-42cd-ab66-74a807d623c3"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:37:23.041119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d49a9eba-4915-4552-875f-ce2cef7305c3 req-25bbfb5e-c968-4512-b202-93a7929fa5fd service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:23.041850 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d49a9eba-4915-4552-875f-ce2cef7305c3 req-25bbfb5e-c968-4512-b202-93a7929fa5fd service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:23.062425 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-d49a9eba-4915-4552-875f-ce2cef7305c3 req-25bbfb5e-c968-4512-b202-93a7929fa5fd service nova] Creating event network-changed:be58011f-fd4e-42cd-ab66-74a807d623c3 for instance 36fedb21-72a2-4052-845e-01d588e3589f on hv-cinder-84884 Jul 06 15:37:23.068646 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-d49a9eba-4915-4552-875f-ce2cef7305c3 req-25bbfb5e-c968-4512-b202-93a7929fa5fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042926 Jul 06 15:37:23.069265 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 577/1107] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:37:23.408173 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:23.416070 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-e51faad2-85af-4484-8acc-2aad63e2e9e8 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.531164 Jul 06 15:37:23.416634 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 531/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:22 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:24.433514 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:24.434215 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:24.440844 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:24.441902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:24.442667 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:24.443099 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:24.571912 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:24.579344 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-163926f5-869e-422f-bd3d-12a3d60af63c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.150099 Jul 06 15:37:24.579914 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 578/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:24 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:25.595979 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:25.596566 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:25.602918 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:25.603408 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:25.604169 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:25.604604 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:25.732285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:25.740113 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-11a56b71-aa1d-40cf-ac5b-babbfdb1f0fc tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.148092 Jul 06 15:37:25.740676 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 532/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:25 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:26.756742 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:26.757352 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:26.763840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:26.764287 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:26.765044 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:26.765475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:26.903284 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:26.910680 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a718da38-9e7c-4ba4-867d-5fbbcf667e1f tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.157833 Jul 06 15:37:26.911262 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 579/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:26 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:27.927640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:27.928248 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:27.934679 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:27.935127 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:27.935911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:27.936354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:28.067420 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:28.074841 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-5b01d31d-8064-4592-bd5a-2149dcff3a11 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.151705 Jul 06 15:37:28.075431 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 533/1112] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:27 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:29.091978 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:29.093097 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:29.100070 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:29.100525 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:29.101281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:29.101718 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:29.231970 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:29.240004 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b2deefac-7b99-466d-8729-954c8dd4f027 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.151939 Jul 06 15:37:29.240577 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 580/1113] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:29 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:30.255612 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:30.256221 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:30.262642 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:30.263089 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:30.263886 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:30.264318 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:30.391485 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:30.399614 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-3c99f6b2-0ff7-4b01-86b7-8271049948b0 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.147778 Jul 06 15:37:30.400174 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 534/1114] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:30 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:31.416812 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:31.417335 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:31.419731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:31.420498 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:31.426934 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:31.427412 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:31.428163 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:31.428595 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:31.559311 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:31.566731 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c403dc81-d86d-42ca-9049-8f9d16e872e4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.153866 Jul 06 15:37:31.567322 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 581/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:31 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:32.582530 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:32.583086 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:32.584988 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell0:SELECT=2 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:32.591267 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:32.591711 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:32.592469 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:32.592897 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:32.725020 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:32.732408 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-f1574da8-f62d-4e5c-ba81-8486ab341016 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.153822 Jul 06 15:37:32.732966 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 535/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:32 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:33.749358 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:33.749997 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:33.757017 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:33.757459 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:33.758212 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:33.758640 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:33.839553 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-66073b48-c2d4-4e93-897b-a3db78417af6 req-804f5f30-b2b9-42ca-bb55-a3eec73e118e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fedb21-72a2-4052-845e-01d588e3589f", "name": "network-vif-plugged", "status": "completed", "tag": "be58011f-fd4e-42cd-ab66-74a807d623c3"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:37:33.847601 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-66073b48-c2d4-4e93-897b-a3db78417af6 req-804f5f30-b2b9-42ca-bb55-a3eec73e118e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:33.848039 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-66073b48-c2d4-4e93-897b-a3db78417af6 req-804f5f30-b2b9-42ca-bb55-a3eec73e118e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:33.858982 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-66073b48-c2d4-4e93-897b-a3db78417af6 req-804f5f30-b2b9-42ca-bb55-a3eec73e118e service nova] Creating event network-vif-plugged:be58011f-fd4e-42cd-ab66-74a807d623c3 for instance 36fedb21-72a2-4052-845e-01d588e3589f on hv-cinder-84884 Jul 06 15:37:33.864158 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-66073b48-c2d4-4e93-897b-a3db78417af6 req-804f5f30-b2b9-42ca-bb55-a3eec73e118e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197941 Jul 06 15:37:33.864688 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 582/1117] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:37:33.891554 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:33.900659 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-77322576-e235-46e6-abff-d1c2681d0c6c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.155147 Jul 06 15:37:33.901219 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 536/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:33 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:37:34.917992 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:34.918626 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:34.924827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:34.925281 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:34.926037 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:34.926471 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:35.053233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:35.060654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-287b0405-ee85-45ad-809c-19c42f748f94 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1267 microversion: 2.1 time: 0.147453 Jul 06 15:37:35.061233 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 583/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:34 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:36.077695 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:36.078323 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:36.084725 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:36.085165 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:36.085909 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:36.086351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:36.217210 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:36.225185 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-beeaa825-06fe-4b92-acd8-7cff6cf0ad7e tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1454 microversion: 2.1 time: 0.151374 Jul 06 15:37:36.225755 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 537/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:36 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:36.240732 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:37:36.241346 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:37:36.247858 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:36.248304 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:36.249067 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:36.249498 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:36.375840 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:37:36.383153 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ee5c0100-f326-4921-9a59-25a9797eaea7 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1454 microversion: 2.1 time: 0.146258 Jul 06 15:37:36.383866 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 584/1121] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:37:36 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:37:38.017182 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-37df47c4-f5bf-49dd-b365-355c92842a0a req-a6a8885f-a7f2-4470-a842-9b1c410a381e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fedb21-72a2-4052-845e-01d588e3589f", "tag": "be58011f-fd4e-42cd-ab66-74a807d623c3"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:37:38.025755 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-37df47c4-f5bf-49dd-b365-355c92842a0a req-a6a8885f-a7f2-4470-a842-9b1c410a381e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:37:38.026193 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-37df47c4-f5bf-49dd-b365-355c92842a0a req-a6a8885f-a7f2-4470-a842-9b1c410a381e service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:37:38.037596 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-37df47c4-f5bf-49dd-b365-355c92842a0a req-a6a8885f-a7f2-4470-a842-9b1c410a381e service nova] Creating event network-changed:be58011f-fd4e-42cd-ab66-74a807d623c3 for instance 36fedb21-72a2-4052-845e-01d588e3589f on hv-cinder-84884 Jul 06 15:37:38.042884 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-37df47c4-f5bf-49dd-b365-355c92842a0a req-a6a8885f-a7f2-4470-a842-9b1c410a381e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137747 Jul 06 15:37:38.043407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 538/1122] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:38:06.526199 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:38:06.526827 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Wed Jul 6 15:38:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:38:20.878760 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:38:20.879351 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Wed Jul 6 15:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:38:47.377120 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:38:47.377654 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Wed Jul 6 15:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:39:07.854856 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:39:07.855803 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=48 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:39:07.858269 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_api:SELECT=20 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:39:07.858988 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG dbcounter [-] [117620] Writing DB stats nova_cell1:SELECT=44 {{(pid=117620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:39:07.860475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:07.860973 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:07.864616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-f6888cc5-4572-42fa-b85b-afda450c468f req-d94e4dc1-c055-4765-a86c-8e51ba116f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fedb21-72a2-4052-845e-01d588e3589f", "tag": "be58011f-fd4e-42cd-ab66-74a807d623c3"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:39:07.869030 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:07.869472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:07.870899 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:07.871432 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:07.874361 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-f6888cc5-4572-42fa-b85b-afda450c468f req-d94e4dc1-c055-4765-a86c-8e51ba116f0f service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:07.874800 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-f6888cc5-4572-42fa-b85b-afda450c468f req-d94e4dc1-c055-4765-a86c-8e51ba116f0f service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:07.887692 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-f6888cc5-4572-42fa-b85b-afda450c468f req-d94e4dc1-c055-4765-a86c-8e51ba116f0f service nova] Creating event network-changed:be58011f-fd4e-42cd-ab66-74a807d623c3 for instance 36fedb21-72a2-4052-845e-01d588e3589f on hv-cinder-84884 Jul 06 15:39:07.893808 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-f6888cc5-4572-42fa-b85b-afda450c468f req-d94e4dc1-c055-4765-a86c-8e51ba116f0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037775 Jul 06 15:39:07.895381 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 539/1123] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 06 15:39:07.897105 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:39:07.977745 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d7e29bb5-bc17-4d70-a2a5-42da4cbc5292 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 204 len: 0 microversion: 2.1 time: 0.124823 Jul 06 15:39:07.981566 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 585/1124] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:39:07 2022] DELETE /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:39:07.990475 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:07.991265 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:07.998222 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:07.998742 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:07.999672 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:08.000190 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:08.162095 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:39:08.170121 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-92216203-355e-4a7f-9707-fb1b0b05da0d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1579 microversion: 2.1 time: 0.184093 Jul 06 15:39:08.170681 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 540/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:07 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1579 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:39:09.188542 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:09.189248 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:09.195754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:09.196209 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:09.196971 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:09.197445 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:09.332761 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:39:09.340902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e9d039f1-58e9-48e2-ac4e-c3cb9942c0a4 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1579 microversion: 2.1 time: 0.156654 Jul 06 15:39:09.341475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 586/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:09 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:39:09.938435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-56271677-bc47-4667-8c7e-d11b25fdec7c req-6bfa3f18-fac2-4904-8cac-853ea1d9c1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fedb21-72a2-4052-845e-01d588e3589f", "name": "network-vif-deleted", "tag": "be58011f-fd4e-42cd-ab66-74a807d623c3"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:39:09.947992 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-56271677-bc47-4667-8c7e-d11b25fdec7c req-6bfa3f18-fac2-4904-8cac-853ea1d9c1e0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:09.948439 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-56271677-bc47-4667-8c7e-d11b25fdec7c req-6bfa3f18-fac2-4904-8cac-853ea1d9c1e0 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:09.960418 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-56271677-bc47-4667-8c7e-d11b25fdec7c req-6bfa3f18-fac2-4904-8cac-853ea1d9c1e0 service nova] Creating event network-vif-deleted:be58011f-fd4e-42cd-ab66-74a807d623c3 for instance 36fedb21-72a2-4052-845e-01d588e3589f on hv-cinder-84884 Jul 06 15:39:09.965380 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-56271677-bc47-4667-8c7e-d11b25fdec7c req-6bfa3f18-fac2-4904-8cac-853ea1d9c1e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030613 Jul 06 15:39:09.965959 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 541/1127] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:39:10.358475 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:10.359124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:10.365678 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:10.366129 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:10.366898 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:10.367368 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:10.399382 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:10.399827 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:10.400270 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lazy-loading 'fault' on Instance uuid 36fedb21-72a2-4052-845e-01d588e3589f {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:39:10.440462 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:39:10.448062 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9a1f4f00-0f35-4a63-927e-2cded18b1b2d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 200 len: 1231 microversion: 2.1 time: 0.094003 Jul 06 15:39:10.448576 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 587/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:10 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:39:11.465414 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:11.466105 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 36fedb21-72a2-4052-845e-01d588e3589f] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:11.472560 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:11.473018 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:11.473786 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:11.474365 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:11.487670 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] HTTP exception thrown: Instance 36fedb21-72a2-4052-845e-01d588e3589f could not be found. Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Request method failure captured: Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f HTTP/1.1 Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixasdl6aiVY6nTw08_3y6r8UhUX8Lj0LGDYzbcRYd7q5s9pP9EooV3g2AvL3Ovljb0rHP2ke_OEZeK-aH2QxvnatfVK6qWn_3sF-UAFwPnr4KRxbhve1nif8UW4qNM9MQyys246XQkGIUuTWFUne6yBb2A8Td68uyRL8rv9fuo-5z6t4 Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:39:11.489285 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 7f9e0665a37d490f8b62205c5890da56 Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 36fedb21-72a2-4052-845e-01d588e3589f could not be found. Jul 06 15:39:11.491001 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '36fedb21-72a2-4052-845e-01d588e3589f'} Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fedb21-72a2-4052-845e-01d588e3589f could not be found. Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:39:11.491878 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fedb21-72a2-4052-845e-01d588e3589f could not be found. Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fedb21-72a2-4052-845e-01d588e3589f could not be found. Jul 06 15:39:11.493228 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:11.494426 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Returning 404 to user: Instance 36fedb21-72a2-4052-845e-01d588e3589f could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:39:11.494426 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-66746004-42c4-4ef4-8fd3-a4b766edb9e2 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f" status: 404 len: 111 microversion: 2.1 time: 0.029902 Jul 06 15:39:11.494426 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 542/1129] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:11 2022] GET /compute/v2.1/servers/36fedb21-72a2-4052-845e-01d588e3589f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:39:14.526607 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:14.527160 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:14.529439 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-1ec558db-9612-44e4-9005-e68388676abc req-dcf73f3d-5b71-428b-b3fc-9def6149be33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723f31b1-47e5-4825-ad25-22d7b21913b1", "tag": "101ed713-aa30-491f-b239-e9d0f48d90ee"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:39:14.534274 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:14.534976 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:14.535789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:14.536207 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:14.537758 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-1ec558db-9612-44e4-9005-e68388676abc req-dcf73f3d-5b71-428b-b3fc-9def6149be33 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:14.538203 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-1ec558db-9612-44e4-9005-e68388676abc req-dcf73f3d-5b71-428b-b3fc-9def6149be33 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:14.549932 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-1ec558db-9612-44e4-9005-e68388676abc req-dcf73f3d-5b71-428b-b3fc-9def6149be33 service nova] Creating event network-changed:101ed713-aa30-491f-b239-e9d0f48d90ee for instance 723f31b1-47e5-4825-ad25-22d7b21913b1 on hv-cinder-84884 Jul 06 15:39:14.555108 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-1ec558db-9612-44e4-9005-e68388676abc req-dcf73f3d-5b71-428b-b3fc-9def6149be33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029656 Jul 06 15:39:14.555911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 543/1130] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:39:14.564621 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 06 15:39:14.660124 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e863539b-6021-4cbb-adfd-9ee4060d7dd6 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 204 len: 0 microversion: 2.1 time: 0.136825 Jul 06 15:39:14.660712 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 588/1131] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:39:14 2022] DELETE /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 06 15:39:14.670263 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:14.671040 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:14.677441 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:14.677888 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:14.678649 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:14.679079 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:14.833220 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.policy [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117620) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:39:14.840954 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-8273d692-87a7-4c3a-adc7-2a2dff173180 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1579 microversion: 2.1 time: 0.175515 Jul 06 15:39:14.841610 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 544/1132] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:14 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 06 15:39:15.859561 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:15.860264 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:15.866663 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:15.867106 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:15.867935 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:15.868374 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:15.996341 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:39:16.003789 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-46223da9-0848-4626-b81b-20cb6229c58b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1579 microversion: 2.1 time: 0.148583 Jul 06 15:39:16.004359 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 589/1133] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:15 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:39:16.541013 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [req-d85a5a38-ae0f-402a-af4a-9c319366228e req-c892b850-12b5-46ca-b7b4-4ab50f9eddc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723f31b1-47e5-4825-ad25-22d7b21913b1", "name": "network-vif-deleted", "tag": "101ed713-aa30-491f-b239-e9d0f48d90ee"}]} {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 06 15:39:16.550232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-d85a5a38-ae0f-402a-af4a-9c319366228e req-c892b850-12b5-46ca-b7b4-4ab50f9eddc4 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:16.550581 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [req-d85a5a38-ae0f-402a-af4a-9c319366228e req-c892b850-12b5-46ca-b7b4-4ab50f9eddc4 service nova] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:16.562091 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.compute.server_external_events [req-d85a5a38-ae0f-402a-af4a-9c319366228e req-c892b850-12b5-46ca-b7b4-4ab50f9eddc4 service nova] Creating event network-vif-deleted:101ed713-aa30-491f-b239-e9d0f48d90ee for instance 723f31b1-47e5-4825-ad25-22d7b21913b1 on hv-cinder-84884 Jul 06 15:39:16.567346 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [req-d85a5a38-ae0f-402a-af4a-9c319366228e req-c892b850-12b5-46ca-b7b4-4ab50f9eddc4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029933 Jul 06 15:39:16.567944 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 545/1134] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 6 15:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 06 15:39:17.021595 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:17.022695 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:17.029420 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:17.029880 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:17.030643 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:17.031308 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:17.064156 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:17.065212 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:17.065669 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lazy-loading 'fault' on Instance uuid 723f31b1-47e5-4825-ad25-22d7b21913b1 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 06 15:39:17.110464 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9e0665a37d490f8b62205c5890da56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d724d364f9b4bafb241a0bb0b02429f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jul 06 15:39:17.119238 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2f66b4d5-f42f-4573-a720-fd7b45fae036 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 200 len: 1231 microversion: 2.1 time: 0.101759 Jul 06 15:39:17.119995 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 590/1135] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:17 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 06 15:39:18.138911 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:18.139637 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: 723f31b1-47e5-4825-ad25-22d7b21913b1] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:18.146086 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:18.146526 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:18.147310 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:18.147747 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:18.160633 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] HTTP exception thrown: Instance 723f31b1-47e5-4825-ad25-22d7b21913b1 could not be found. Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Request method failure captured: Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 HTTP/1.1 Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixasdl6aiVY6nTw08_3y6r8UhUX8Lj0LGDYzbcRYd7q5s9pP9EooV3g2AvL3Ovljb0rHP2ke_OEZeK-aH2QxvnatfVK6qWn_3sF-UAFwPnr4KRxbhve1nif8UW4qNM9MQyys246XQkGIUuTWFUne6yBb2A8Td68uyRL8rv9fuo-5z6t4 Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:39:18.162264 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 7f9e0665a37d490f8b62205c5890da56 Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance 723f31b1-47e5-4825-ad25-22d7b21913b1 could not be found. Jul 06 15:39:18.163898 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': '723f31b1-47e5-4825-ad25-22d7b21913b1'} Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723f31b1-47e5-4825-ad25-22d7b21913b1 could not be found. Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:39:18.164812 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723f31b1-47e5-4825-ad25-22d7b21913b1 could not be found. Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723f31b1-47e5-4825-ad25-22d7b21913b1 could not be found. Jul 06 15:39:18.166304 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.167750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Returning 404 to user: Instance 723f31b1-47e5-4825-ad25-22d7b21913b1 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:39:18.167750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-0a2f9ffe-9dc8-42cc-9053-7f45ae50907c tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1" status: 404 len: 111 microversion: 2.1 time: 0.030321 Jul 06 15:39:18.167750 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 546/1136] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:18 2022] GET /compute/v2.1/servers/723f31b1-47e5-4825-ad25-22d7b21913b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:39:18.602178 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:18.602675 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:18.609942 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:18.610398 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:18.611170 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:18.611777 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:18.625472 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] HTTP exception thrown: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Request method failure captured: Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 HTTP/1.1 Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept: application/json Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Connection: close Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Host: 10.222.0.46 Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABixasdl6aiVY6nTw08_3y6r8UhUX8Lj0LGDYzbcRYd7q5s9pP9EooV3g2AvL3Ovljb0rHP2ke_OEZeK-aH2QxvnatfVK6qWn_3sF-UAFwPnr4KRxbhve1nif8UW4qNM9MQyys246XQkGIUuTWFUne6yBb2A8Td68uyRL8rv9fuo-5z6t4 Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Role: member,reader Jul 06 15:39:18.627123 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Roles: member,reader Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Id: 7f9e0665a37d490f8b62205c5890da56 Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: method: > Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: exception: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.628754 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: action_args: {'id': 'c304cb7c-8615-4f10-836c-78b4ae231d57'} Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:39:18.629672 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.631155 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.632728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Returning 404 to user: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:39:18.632728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dc62d110-3b4d-4fdc-a278-4e9adc08dc95 tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 404 len: 111 microversion: 2.1 time: 0.030281 Jul 06 15:39:18.632728 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 591/1137] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jul 6 15:39:18 2022] DELETE /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:39:18.637010 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '>' {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:18.637618 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.compute.api [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] [instance: c304cb7c-8615-4f10-836c-78b4ae231d57] Fetching instance by UUID {{(pid=117620) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 06 15:39:18.643907 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:18.644354 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:18.645109 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 06 15:39:18.645905 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG oslo_concurrency.lockutils [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Lock "817b0a4d-22b1-494d-b98d-37da4df0b98a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 06 15:39:18.660407 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.wsgi [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] HTTP exception thrown: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Request method failure captured: Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: request: GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 HTTP/1.1 Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept: application/json Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Accept-Encoding: identity Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Connection: close Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Length: 0 Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Content-Type: application/json Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Host: 10.222.0.46 Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Openstack-System-Scope: None Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: User-Agent: python-urllib3/1.26.9 Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Auth-Token: gAAAAABixasdl6aiVY6nTw08_3y6r8UhUX8Lj0LGDYzbcRYd7q5s9pP9EooV3g2AvL3Ovljb0rHP2ke_OEZeK-aH2QxvnatfVK6qWn_3sF-UAFwPnr4KRxbhve1nif8UW4qNM9MQyys246XQkGIUuTWFUne6yBb2A8Td68uyRL8rv9fuo-5z6t4 Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Id: None Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Domain-Name: None Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Identity-Status: Confirmed Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Is-Admin-Project: True Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Id: default Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Domain-Name: Default Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Project-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Role: member,reader Jul 06 15:39:18.661891 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Roles: member,reader Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d724d364f9b4bafb241a0bb0b02429f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Id: 6d724d364f9b4bafb241a0bb0b02429f Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1522310594 Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Id: default Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Domain-Name: Default Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Id: 7f9e0665a37d490f8b62205c5890da56 Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: X-User-Name: tempest-TestVolumeBootPattern-1522310594-project Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: method: > Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: exception: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.663768 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: action_args: {'id': 'c304cb7c-8615-4f10-836c-78b4ae231d57'} Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: {{(pid=117620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 06 15:39:18.664616 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. Jul 06 15:39:18.665964 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: ERROR nova.api.openstack.wsgi Jul 06 15:39:18.667232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: DEBUG nova.api.openstack.wsgi [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Returning 404 to user: Instance c304cb7c-8615-4f10-836c-78b4ae231d57 could not be found. {{(pid=117620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 06 15:39:18.667232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO nova.api.openstack.requestlog [None req-7d13bb6f-a891-4472-bfc6-eeea6d87732d tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57" status: 404 len: 111 microversion: 2.1 time: 0.030062 Jul 06 15:39:18.667232 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: [pid: 117620|app: 0|req: 547/1138] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jul 6 15:39:18 2022] GET /compute/v2.1/servers/c304cb7c-8615-4f10-836c-78b4ae231d57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 06 15:39:19.943902 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-46914aa1-5552-4bf4-a0b4-bff17c10f72b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] Calling method '.version_select at 0x7f449d6a3670>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 06 15:39:19.969635 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-46914aa1-5552-4bf4-a0b4-bff17c10f72b tempest-TestVolumeBootPattern-1522310594 tempest-TestVolumeBootPattern-1522310594-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1567947179" status: 202 len: 0 microversion: 2.1 time: 0.029458 Jul 06 15:39:19.974119 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 592/1139] 10.222.0.46 () {58 vars in 1262 bytes} [Wed Jul 6 15:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1567947179 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 06 15:39:52.949080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:39:52.949080 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Wed Jul 6 15:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:41:26.534387 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:41:26.534930 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Wed Jul 6 15:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:41:40.887693 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:41:40.888435 dv-cinder-848848-4-iscsi devstack@n-api.service[117620]: Wed Jul 6 15:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:41:57.135261 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:41:57.135792 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Wed Jul 6 15:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:42:07.385245 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:42:07.385821 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Wed Jul 6 15:42:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 06 15:43:12.956574 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 06 15:43:12.957229 dv-cinder-848848-4-iscsi devstack@n-api.service[117619]: Wed Jul 6 15:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!